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ABSTRACT 

Thfe vocational education reacher was the focus of 
this study designed to gain a better understanding of hoi/ 
coBsunication relates to teaching effectiveness in a vocational 
setting. Teaching effectiveness was defined in terai^ of four 
criteria: supervisor evalt^ations of teachers, studeiit evaluations of 
teachers, absentee rate, and drop rate. The teachers who served as 
subjects for the study ca«(» froa a nuaber of industrial education 
programs located in Florida secondary schools, vocational- technical 
centers, and couunity colleges. Tvo trained observers spent two days 
with each teacher recording his behavior and the behavior of his 
students. Underscoring the importance of coaaunication skills, this 
study showed that there were identifiable differences in behavior 
aaong teachers categorized according to supervisor and/or student 
ratings. The »»best»» teachers were very dynaaic, had superior delivery 
skills, spent a great aaount of tiae in direct contact with their 
students, and created a pleasant social-eaotional environment through 
the use of positive reinforce aent and banter. Seven recoaaendations 
were aade for vocational education on the basis of the findings in 
this study. (Author/RB) 
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ABSTRACT 



The purpose of this study was to gam a better understanding of 
how communication relates to teaching effectiveness in the setting of 
vocational education. Teaching effectiveness was defined in terms of 
four criteria: 1) supervisor evaluations of teachers, 2) student 
evaluations of teachers, 3) absentee rate, and 4) drop rate. The 
focus of the study was the vocational education teacher , whose behavior 
and attitude determine to a great extent the quality and quantity of 
learning that takes place in the classroom. Since few studies had 
analyzed communication in the vocational setting (especially the shop 
situation) and even fewer had attempted to relate classroom commimica- 
tion to teaching effectiveness, this effort proceeded in a manner which 
might be described as macroscopic. 

Direct observation was used as the means of collecting data, and 
a number of instruments were developed to tap various aspects of verbal 
and nonverbal communication. One of the instruments took into consideration 
the frequency and duration of contacts between the teacher and his students, 
the amount and kind of praise and criticism that the teacher gave, the 
amount of time spent in interruptions, and the number of times the 
teacher engaged in banter with his students. Another instrument was 
designed to assess the teacher's organization and presentation skills, 
and the degree to which he displayed enthusiasm and self-confidence as 
he conducted his class. Additional measures of behavior, e.g., the 
manner in which students were addressed, the heterogenity of shop 
activities, etc., were included, along with a measure of the teacher's 
attitude toward various aspects of teaching, to give as complete a 
picture of the communication environment as was possible. Finally, these 
measures were supplemented by information about the teacher's background, 
his program and students, and by a narrative account of the day's 
activities. The purpose of the narrative was to give a description of 
the overall style of the teacher and the perceived relationship between 
him and his students. 

The teachers who served as subjects for the study came from a number 
of Industrial education programs whose shop and classroom activities were 
conducted in a relatively similar manner. The majority of the teachers 
taught in mechanics -tyje programs such as Auto Mechanics and Air Conditioning 
and Keating Mechanics. Most of the remaining teachers came from Machinist 
and Welding programs. The teachers were located in three types of schools: 
secondary schools; vocational -technical centers, and community colleges. 

Two trained observers spent two days with each teacher recording 
his behavior and the lehavior of his st'jdents. The primary measures used 
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in the analyses were the averages of the two days* data. The observers 
collected data in 14 counties throughout the state. Wliile most of the 
counties were located in the northern portion, an equal number of teachers 
were selected from the northern half of the ?tate (using Orange County as 
the dividing line) and the southern half. It took approximately eight 
months to collect the data. 

Once the data were collected, several factor analyses were made 
and, on the basis of the results, the data were combined into various 
indices of communication and attitude. Two kinds of analyses were then 
performed: 1) one-way analyses of variance in which teachers were separated 
into high, moderate, and low groups (using t:he scores on each teaching 
effectiveness criterion as the basis for grouping) and a determination was 
made of the communication skills and dimensions of teacher attitude that 
discriminated among the three groups of tes.chers; and 2) multiple x-cgTes«5ion 
analyses which consisted of selecting from the various measures of coOv ■ - 
cation, attitude and information about the teacher, his program, and hit 
students, the best predictors of each teaching effectiveness criterion. 
addition to these, teachers were separated according to the size of thei*. 
classes and the race of the teachers and their students, and the effects 
of each of these variables upon certain ar.pects of communication were 
analyzed. 

The results of the analyses underscored the importance of communi- 
cation skills in the teaching/ learning process. The most critical measures 
of communication, or at least the most critical of the ones selected for 
study, had to do with how dynamic the teacher was (i.e., how well he could 
move about the shop in a manner that conveyed self-confidence, organizational 
ability, and enthusiasm) ; how well he could present his material (his 
delivery); how much time he spent with his students; and how often he 
praii^ed their work and bantered with them. 

Although four criteria were selected as indicators of taaching 
effectiveness, only two of them, supervisor and student ratings of 
teachers, were useful in determining the relationship between teaching 
effectiveness and communication. The other two criteria, drop rate and 
absentee rate, were primarily related to the age of the teacher and the 
age of his students. They had little to do with his communication behavior. 

This study showed that there were identifiable differences in 
behavior among teachers categorized according to supervisor and/or 
student ratings. The "best" teachers were very dynamic, had superior 
delivery skills, spent a great amount or time in direct contact with their 
students, and created a pleasant social -emotional environment through 
the use of positive reinforcement and banter. These characteristics 
and a positive attitude toward students were important determinants of 
favorable supervisor or student evaluations. Only Dynamism, however, was 
an important determinant of both. 

On the basis of these findings, a number of recommendations were made. 
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1) Since the usefulness of this research depends ultimately 
upon the changes that a teacher makes in his behavior in order to become 

a better teacher, it was recommended that a population of Industrial Educa- 
tion teachers similar to the teachers who received low ratings (from 
supervisors or students) in this study be identified and invited to 
participate in an experimental teacher-training program in commtjnication. 
A systematic study of changes in the teachers* behavior and consequent 
changes in their supervisor and student ratings would determine, in part, 
the validity of the findings of this study and their usefulness as a guide 
in training teachers to become more effective communicators. 

2) The suggestion was made that the findings of this report be 
disseminated to all Industrial Education teachers. However, due to the 
technical nature of this monograph, it was recommended that an additional 
report, written in layman's terminology, be prepared. 

3) In order to maximize the utilisation of the data, a recommendation 
was made that additional data (e.g.. a measure of self-esteem) be collected 
from the sample of teachers and analyzed in relation to the data that already 
exist . 

4) The development of additional "teaching effectiveness" c^i^®^^* 
for the evaluation of vocational education programs was also recommended. 
Such criteria might include not only skills-relctted measures but also measures 
of change in values, interests, and attitudes, the necessary concomitants 

of the acquisition of a skill. Improved criteria of teaching effectiveness 
are essential for the improvement of instruction. 

5) Because of the uniqueness of the shop and classroom activities 
in the programs studied, the findings could not be generalized beyond the 
area of Industrial Education. Therefore, it was recommended that a 
replication of this study be made for other areas of vocational education, 
e.g.. Business Education, Home Economics, etc. Results from studies in 
these areas would facilitate a more unified approach to the development 
of pre-service and in-service teacher-training programs in communication. 

6) Currently, there is no course in communication designed specifically 
for the vocational education teacher. Therefore, the suggestion was made 

that such a course could be constituted, at least for Industrial Education 
teachers, from the data collected. Once studies have been conducted in 
other areas of vocational edi nation, similar courses could be developed. 
Ultimately, consideration should be given to incorporating such courses into 
the certification requirements of vocational educators. 

7) The value of a vocational program is related in many ways to 
factors beyond the teacher's control. Some of these factors involve 
communication. For instance, students communicate during the day not only 
with teachers but also with other students, counselors, and administrators. 
Their relationships to these groups may determine to some extent their 
attitudes toward t:he program and the degree to which they are motivated to 
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acquire a skill. Thus, a recommendation was made that studies be 
conducted at other levels of communication besides the classroom. 
Such studies might focus upon administrators and various aspects of 
organizational communication, or upon students and their interactions 
with counselors, administrators, and other students. In sum, it was 
recognized that the most fruitful approach to understanding communication 
in vocational education is to consider the total communication environment. 
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INTRODUCTION 



Problem 

In the next few years increasing demands will be placed upon voca- 
tional educators to implement and sustain programs for the burgeoning 
population of career- oriented individuals. The U. S. Office of Education 
estimates that by the mid- 1970 's 345,000 teachers will be needed in voca- 
tional fields alone. 1 Such demands make salient in Florida and elsewhere 
the critical problem of teacher selection and preparation. Schaefer points 
out that : 

There is need for . . . individuals with subject 
matter expertise and intellectual ability, but 
also with personal attributes which intensify 
learning— individuals with, in Stone's words, 
'the ability to listen, who emphasize inquiry, 
social sensitivity and self -direct ion, and who 
are around and about the classroom, guiding, 
probing, and encouraging. 

In essence, what Schaefer and Stone suggest is that teachers need to be 
aware of and develop the necessary communication skills to facilitate the 
learning process. 

Research on human communication indicates that many factors are 
potentially responsible for differences among teachers in t' eir ability 
to communicate effectively. In certain situations, these differences 
might be great enough to affect the amount and kind of learning that takes 
place. Some studies show, for example, that a student's perception of 
the teacher's personal credibility may be affected by the teacher's pre- 
sentation skills. One aspect of presentation skills, speaker nonfluency, 
has been shown to decrease the listener's ratings of the credibility of 
the speaker.^ Other presentation factors-- including rate of speaking, 
loudness, and vocal inflect ion- -also seem to have an impact upon the 
listener's perception of the speaker's credibility. 

Presentation skills constitute only one of the potential problems 
in communication. Numerous other factors, some nonverbal, must be con-, 
sidered as potential barriers to effective communication. Hall, for 
instance, tells the story about his appointment to a committee on human 
relations, the purpose of which was to ascertain the chances for adopting 
non-discriminatory practices by various city officials. Although each 
official's verbal statement indicated a positive attitude toward the 
idea. Hall detected that a better perception of their position could be 
gained from observing their use of time and space- -what he termed the 
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"silent language." Delayed or forgotten appointments, hurried interviews, 
and the distance and barriers maintained by the officials coiumunicated 
much to hall about their true feelings.^ 

A similar situation exists in the teaching/learning process where 
the symbiotic relationship between the development of attitudes, interests, 
and values (the affective realm) and the acquisition of knowledge is often 
fostered by the teacher's nonverbal activities. Consider, for example, 
the vocational teacher who is habitually late or who neglects safety stan- 
dards in the shop. Such nonverbal behaviors are soon likely to be i:rans- 
formed and integrated into the student's value system. Moreover, when the 
teacher attempts to impress upon the student the importance of safety and 
punctuality in the world of work, his personal credibility- -an important 
communication variable-- is likely to be questioned and his message ignored. 

While a number of research findings suggest the possible kinds of 
behaviors that are likely to facilitate or impede communication in the 
classroom, there are few substantive studies which identify specifically 
what those behaviors are. For the aspiring or practicing vocational educa- 
tion teacher, whose teaching environment is often different from the tra- 
ditional classroom arrangement, the picture is even less enlightening. 
To our knowledge, no one has conducted a macroscopic analysis of teaching 
behavior in the vocational education setting. The few studies that have 
attempted to identify "patterns" of teaching behavior have often failed 
to link those patterns to established criteria for teaching effectiveness. 
The purpose of this study, therefore, is to analyze communication in the 
vocational education setting and to identify those behaviors that relate 
to various criteria of effective teaching. Hopefully, the results from 
this study can be used as a guideline in the development of pre-service 
and in-service teacher training programs in communication, for as Schaefer 
notes: "Ability to convey subject matter, combined with insight into human 
behavior, constitutes a powerful teaching tool for any educator."^ 

Prior Research 

For many years scholars have attempted to analyze classroom communi- 
cation. Much of this research has used the method of direct observation 
to collect data. Categorizing the behavior of the teach:^r and students, 
researchers have been able to identify different patterns of communication. 
Most of these studies have been synthesized elsewhere;^ therefore, we 
will concentrate on reviewing some of the more recent studies that have 
been conducted. 

The Flanders system of interaction analysis has been one of the most 
widely used methods for determining classroom communication patterns. 
Flanders, building upon earlier research, developed a category system for 
classifying the teacher's verbal behavior. Each behavior is coded by an 
observer at three-second intervals and later transformed into a matrix 
which allows the researcher to determine the overall pattern of teacher- 



student interaction. The major thrust of studies utilizing the Flanders 
instrument has been to assess whether the teacher uses a direct or an 
indirect approach, the latter supposedly being the most effective style 
and characterized by the teacher's acceptance of the student's feelings 
and ideas and his use of praise and inquiry. The direct approach is 
characterized by a lack of student participation and the teacher's use 
of criticism. 

Flanders recently reviewed the research utilizing the interaction 
analysis instrument and found that the relationship between patterns of 
communication and learning outcomes (student achievement and attitude) 
may be nonlinear. This was especially true when the achievement criteria 
consisted of tasks requiring less abstract reasoning. For the lower leVel 
cognitive tasks, an optimum point was found for teacher indirectness. In 
other words, for these kinds of tasks, students were able to tolerate 
higher levels of criticism and non-participation. 

When sustained acceptance of students' feelings and ideas was 
correlated with attitude toward the teacher, a similar curvilinear 
relationship was found. While sustained acceptance was generally 
associate'' with favorable attitudes, an excessive use of this resulted 
in less favorable attitude scores. 

Despite these results, Flanders believes that the majority of 
studies support the notion that: "The percent of teacher statements 
that make use of ideas and opinions previously expressed by pupils 
is directly related to average class scores on attitude scales of 
teacher attractiveness, liking the class, etc., as well as to average 
achievement scores adjusted for initial ability. 

Bellack et al_. used a somewhat different classification system , ^ 
in their analysis of verbal discourse in fifteen social studies classes. 
Statements were categorized according to the pedagogical function they 
served, e.g., structuring, soliciting, responding, or reacting. Each 
category was twice further subdivided into more specific units of meaning. 
The analysis was based on recordings (and transcriptions) made of a 
standardized unit of instruction in each class. Besides a description 
of the general pattern of communication, the researchers attempted to 
relate linguistic variables to learning outcomes. While attitude change 
toward the subject matter showed little variation from one class to 
another, an analysis of adjusted scores of knowledge gained revealed 
significant differences (at the .10 Jevel of confidence) among 
several of the classes. Separating them into high and low gain 
groups, however, failed to reveal any clear-cut differences in linguistic 
patterns. It should be noted that for the analyses of the high and low 
gain groups the researchers did not test for significance on -.ny of 
the communication variables presented; therefore, their speculations 
about differences that did exist are tenuous. 

In recent years researchers interested in classroom communication 
have begun to consider the nonverbal as well as the verbal aspects of 
communication. Calloway states that: 



The teacher plays various roles in an instructional 
setting, and prevading [sic] all the roles the teacher 
enacts is the process of verbal and nonverbal communi- 
cation. The teacher is both a sender and receiver o^" 
messages. In the nonverbal dimension of coromunicatvvn, 
*the teacher conveys messages in many diverse ways. 
According to many writers in educational literature, 
both the teacher and the pupil tend to transmit their 
attitudes and feelings through nonverbal channels. 
Indeed, many writers and researchers . . . make the 
assumption that nonverbal cues are at least as signi- 
ficant as verbal remarks when a pupil attempts to 
ascertain the feelings, intentions and attitudes of 
the teacher. Thus, if the assumption is sound, non- 
verbal expressions are paramount considerations for 
understanding the communicative process in the class- 
room; and such expressions have significant implications 
for teacher-pupil relationships.^^ 

Galloway developed a category syscem for coding the teacher's nonverbal 
behavior (most of which could be classified as para linguistic behavior) . 
He observed that most teacher behavior could be conceived of as encourag- 
ing or inhibiting communication. Data were collected from six elemen- 
tary classrooms. In addition to data derived from the category system. 
Galloway utilized data taken from descriptive narrations of the teacher's 
communication. These narrations were rated by three judges according 
to the percentage of encouraging, neutral, or inhibiting behaviors. Also, 
three experts from the fields of communication, curriculum, and leadership 
observed the teachers and made a global assessment of nonverbal communi- 
cation. Results showed little relationship among the three measures, although 
correlations between the two observers using the classification system and 
correlations among the three judges rating transcriptions were significant. 

Students* perception of the teacher's attitude were also obtained 
and correlated with the various measures of nonverbal communication. The 
only significant relationship found was for the curriculum expert whose 
rankings of teachers from most encouraging to least encouraging correlated 
.94 with students' rankings of teacher attitude. 

More recently, Galloway's category system for nonverbal communication 
has been combined with the interaction analysis instrument developed by 
Flanders. Besides assessing the direct versus indirect teaching approach, 
researchers can now determine whether the method is encouraging or restric- 
tive. 

Locpp also combined categories of verbal and nonverbal communication 
in his study of ten junior high school industrial arts teachers.^ Two 
classifications of nonverbal communication were used: 1) nonverbal direct, 
consisting of those instances when the teacher's nonverbal behavior trans- 
mitted information or direction to one or more students; and 2) nonverbal 
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indirect, consisting of those nonverbal activities which indirectly 
influenced the class, e.g., the teacher moving about the classroom, 
the verbal classifications were similar to those of the Flanders 
instrument except for one category. The category "lecturing" was 
changed to "information giving" since formal lectures rarely occurred 
in industrial arts classrooms. 

Loepp concluded from his analysis that the instrument he used 
was a reliable and valid category system for providing data concerning 
teacher- student interaction. While he stated that the instrument could 
be used to identify effective teaching patterns, he offered no evidence 
as to the composition of those patterns or what criteria would be used 
to judge them as effective and ineffective. 

The instrument developed by Loepp was used by Kruger in a similar 
study of industrial arts teachers at the junior high school level. 
Twenty teachers participated in the study, and based on the findings, 
Kruger recommended that: 

Existing and future industrial arts teachers 
should have an excellent command of 'communica- 
tive tools.' Since much of the teacher's time 
is spent in giving directions and information 
to students, this information should be clear, 
concise, and easily understood by the students 
so as to allow the teacher to make as many 
contacts with students during a period as 
possible. 

This study, like that of Loepp, provided only descriptive data. 
No attempt was made to establish any criteria for teaching effectiveness 
and to relate these to the interaction patterns. Although the small 
sample size prevented certain correlational techniques, e.g., regression 
analysis, selecting teachers according to some theoretical notions about 
communication might have enabled a more sophisticated treatment of the 
data. Instead, Kruger noted that an attempt was made to "include a 
wide range of factors (e.g., socio-economic) which might affect classroom 
climate. "20 This approach, combined with the small sample size, restricted 
the kinds of analyses that might have shed light on the relationship between 
communication and other possible factors affecting the teaching/ learning 
environment . 

Like Galloway and Loepp, Grant and Hennings also incorporated 
aspects of nonverbal communication into their measuring instrument. 
Building upon the work of Bellack et. §1 • » these researchers described 
the nonverbal behavior of five elementary school teachers whose classroom 
sessions were videotaped and later analyzed. Nonverbal behavior was 
characterized as either instructional (conducting, acting, and wielding) 
or personal (mannerisms that serve no instructional purpose) . Clarifying 
these behavior categories. Grant and Hennings state: 
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At the physical level, he [the teacher] is 
performing as a conductor, using gestures 
and motions that often bear a striking resem- 
blance to the gestures and motions of a musical 
conductor. The teacher is also performing as 
an actor, building interest and clarifying 
meanings with his body. In addition, he is 
performing as a technician, wielding aspects 
of the environment. Finally, the teacher 
is performing as a human being, bringing 
with him into the classroom personal motions 
that do not have an instructional purpose. 

The results of their study revealed that teachers used instructional 
motions four times as often as personal ones. The majority of the instruc- 
tional nonverbal behavior was classified as conducting (62%), followed 
by wielding behaviors (29%), and then acting (9%). With such a small 
sample size, however, it was impossible to relate nonverbal communication 
to teaching effectiveness. Thus, while differences in teaching styles 
(patterns of verbal and nonverbal behavior) were found, the researchers 
could only speculate on the iii?)ortance of those differences. ^ 

Summary 

In reviewing the research on classroom communication, several 
points are worth noting. First of all, in many of the studies too few 
teachers have been analyzed to determine whether significant relationships 
exist between particular behavior patterns and criteria which might be 
considered representative of effective teaching. As a result, except 
in a general sense, it is difficult to specify which communication 
behaviors will lead to the desired learning outcome. 

Secondly, most of the studies involved teachers in elementary and 
secondary schools in traditional classroom settings. In many vocational 
education programs, an entirely different classroom structure exists. 
Furthermore, the types of activities that take place are often different, 
and therefore communication patterns are likely to vary. For example, 
as Loepp discovered, formal lecturing may be the exception rather thrn 
the rule. In a shop situation where students often work independently 
on their projects, the teacher's ability to interact with each student 
individually may be one of the most important communication variables 
to consider, for this aspect of communication tells us something about 
the teacher's use of time. Noting the importance of this variable. 
Galloway reports that: 

How teachers use their time indicates the value 
and importance they place on something. . , . 
Teachers do not ordinarily recognize the meaning 
of their use of time, but students can frequently 
relate what a teacher's preferences are and what 
the teacher dislikes. 
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Besides the frequency and perhaps duration of contacts he makes, 
the teacher may also reveal information about himself by whom he chooses 
to contact. Consider the teacher who is constantly helping one group 
of students while neglecting another group. Such a situation could 
exist when students of different races or different socio -econondc levels 
are enrolled in the same class. It seems reasonable to assume, for 
example, that white teachers may feel more comfortable interacting with 
white students, while black teachers may be more apt to spend a greater 
proportion of their time with black students. Although any discrimina- 
tory behavior may be performed unconsciously by the teacher, chances are 
the neglected students will be aware of this behavior and will form a 
different opinion about the teacher from the group that is favored. 
In some instances, this difference could act as a barrier to effective 
communication. 

To summarize, research on teaching behavior suggests that con- 
sideration must be given to nonverbal as well as verbal aspects of 
communication. However, to our knowledge, few studies have included 
a sufficient number of teachers to make a meaningful analysis of the 
relationship between communication and teaching effectiveness. Also, 
as far as we know, no studies exist that take into consideration the 
unique teaching environment found in many vocational education programs. 

On the basis of these findings, it seems necessary, if vocational 
education teachers are to understand and develop effective communication 
skills, that a study of teaching behavior in the vocational setting be 
implemented. In discussing the design and instruments for such a study, 
it should become apparent that in many respects this research is without 
precedents, and is therefore largely exploratory. Given this limitation, 
it seemed best to us to proceed in a manner which might be characterized 
as macroscopic. 
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PROCEDURE 



Design of the study 

Various methods of gathering communication data in the vocational 
setting were considered. The most economical (but perhaps least reliable) 
method consists of asking teachers for a self -report of their perceived 
communication behavior. In terms of time, money, and execution, this 
would be the most convenient way to gather data. In terms of the useful- 
ness of the results, however, the disadvantages seemed to far outweigh 
the merits. 

Prior research has shown the usefulness of measuring teaching 
behavior by systematic observation. Despite its obtrusive nature, direct 
observation has many advantages. Medley and Mitzel note that: 

If an investigator visits a group of classrooms, 
he can be sure that, regardless of his presence, he 
will see teachers teaching and pupils learning; he 
will see better and poorer teachers; effective and 
ineffective methods, skillful and unskillful use of 
theory. If he does not see these things, and measure 
them, it will not be because these things are not 
there to see, record, and measure. It will be because 
he does not know what to look for, how to record it, 
or how to score the records; in short, he doej not ^ 
know how to measure behavior by systematic observation. 

The method of direct observation was incorporated into the 
design of the present study. 

With the availability of sophisticated technology, there are 
some alternatives for direct observation. For exaiuple, lightweight 
videotape equipment can be used to record teacher and student activities. 
These recordings can then be played back at a later time and analyzed 
for their communication content. One advantage of this method is 
that an actual and permanent record is made of the classroom activities, 
thereby enabling the observer or anyone else to recheck the coding for 
any problems that might arise. 

Another procedure, especially applicable to the vocational shop 
arrangement, is to have the teacher wear a microphone with radio trans- 
mitting conqponents . (This eliminates the use of a cord.) A small, 
portable FM radio can then be stationed in a location convenient to the 
observer and tuned to the microphone -transmitter's frequency. From 



10 



one location, the teacher's verbal behavior can then be monitored 
and recorded. 

Both the videotaping and microphone- transmitting methods were 
tried, but neither yielded satisfactory results. The novelty of the 
television camera constantly following the teacher about the shop was 
simply too distracting. Also, taping and analyzing the sessions 
afterwards doubles the amount of time that has to be spent with each 
teacher. These factors, coupled with the cost of equipment and tapes, 
negated the use of the video recorder as a method of observation. 

The use of a microphone-transmitter was also unsatisfactory. 
The existence of metal materials in the shop sessions and the distance 
from the teacher to the radio receiver often affected the quality of 
the radio signals, rendering them at times inaudible. Although an 
attempt was made to create a more powerful antenna, the quality of 
the signal produced remained inconsistent. 

Another disadvantage of the microphone- transmitter method was 
its inability to record nonverbal communication. Since the observer 
stayed in one position, he could not always see the teacher who may 
have turned away or have moved outside the immedxate shop area. Then, 
too, the microphone, liKe the television taaiera, readily reminds the 
teacher and students that their activities are being monitored. 

ITie method that proved most satisfactory in a shop situation was 
for the observer to follow the teacher as he traveled about. Practice 
showed that the observer could stay several feet away from the teacher 
and still record his behavior. At the same time, the observer could 
assess the behavior of the student as he interacted with the teacher and 
could note the duration of the interaction. In a classroom situation, 
the observer could position himself in a strategic location where he 
could remain for the entire session. This procedure was similar to the 
one used in many behavioral studies of elementary and sec« dary school 
teachers . 

Subjects 

One of the prerequisites for selecting teachers was that the sarapl 
had to be drawn from vocational programs in which the activities were 
relatively similar. The reason for this was that measuring instruments 
that take into consideration the teacher's use of time and space may not 
be reliable if the kinds of classroom sessions vary greatly. For example 
it seems highly probable that a teacher confined to a traditional type 
classroom as found in many office education programs would use time and 
space differently from the teacher whose instruction takes place in an 
auto repair shop. The relatively more spacious shop area may require 
more time for the teacher to contact each student and more effort to 
maintain organization since the traditional arrangement probably enables 
better surveillance. 



While these assumptions about variations in activities were not 
formally tested, they were based on observations made in variot voca- 
tional classes. Following these observations it was decided t' it we 
should cither analyze teachers separately according to their teaching 
environment or concentrate on one particular teaching environment, e.g., 
the shop arrangement. The latter alternative was chosen because it 
allowed us to have twice the sample size for the same type of teacher 
activities, thus enabling more reliable analyses. (Budgetary considera- 
tions were such that our anticipated total sample size would be approxi- 
mately 120 teachers.) Also, we chose to study teachers who taught in 
the shop-type programs since few commu::^ication guidelines existed for 
teachers in this kind of teaching environment. 

Despite the fact that the shop is the place where most teaching 
activities take place, in these type programs teachers often utilize 
in the course of the day the more formal classroom situation as well. 
Therefore, in many instances we would be able to compare the teacher's 
communication skills in both kinds of teaching environments. 

Many of the shop -type programs fall under the heading of Industrial 
Education, the third largest vocational program section according to student 
enrollment in vocational -technical programs in Florida in 1970.2 We 
therefore selected teachers from Industrial Education programs whose 
physical facilities engendered somewhat similar teacher and student 
activities. The programs included: 

Air Conditioning and Heating Mechanics 

Auto Body Repair 

Auto Mechanics 

Aviation Mechanics 

Diesel Mechanics 

Diversified Mechanics 

Gasoline Engine Mechanics 

Machine Shop Work 

Marine Engine Mechanics 

Welding 

Mi 11 work Shop 

Agricultural Mechanics 

Sheet Metal 

Plumbing 

Teachers in Industrial Education are found in secondary, post 
secondary, adult, and exemplary programs. After having visited each 
of these, we decided to omit from our study teacher*? in the exerapla.y 
programs. Because of the uniqueness of these nrograms, we believed 
that our criteria for teaching effectiveness would not be satisfactorily 
comparable between teachers in the exemplary programs and the others. 

The various programs that we did select are found in vocational 
and secondary schools and community colleges. The Florida Industrial 
Education directory of teachers and administrators served as a handy 
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guide for choosing counties that had secondary schools* vocational 
centers* and community colleges with a sufficient number of teachers 
(Appendix A) in the appropriate programs.^ A letter explaining the 
nature and purpose of the study was sent from the state director of 
vocational education to variou? county school superintendents and 
community college presidents (Appendix B) inviting them to participate 
in the project. Following notification of a desire to participate in 
the study (Appendix C) , we contacted the designated vocational adminis- 
trators and supplied them with sufficient copies of the Teacher Assessment 
Inquiry Form (Appendix D) . We requested that a form be completed for 
each teacher in the programs we had listed* The completed forms were 
then returned directly to us. They were not seen by the individuals 
who observed and recorded the behavior of the teachers. 

Once the teacher evaluation forms had been scored, they were 
divided into three groups: high, middle, and low. From each of these 
groups, a random sample of teachers was selected. The purpose of 
stratifying the sample was to enable us to rank order the teacher 
evaluation scores and to compare the communication skills of teachers 
whose scores fell in the upper quartile with those whose scores were 
in the middle 50 per cent or lower quartile of the sample. Initially, 
we had hoped to have all forms returned before we began selecting our 
sample. However, this was not the case. By the time our observers were 
ready to begin collecting data, we had received teacher evaluations from 
only a few administrators. Thus, the sampling process continued along 
with the study. As a result of this procedure, because we purposely 
wanted three fairly evenly divided groups of teachers, it became 
necessary as more evaluations were returned to choose relatively fewer 
of the highly rated teachers and more of the lowly rated ones to maintain 
proportionality. This was due to the fact that the teacher evaluation 
forms were almost always scored positively. While saiopling from each 
school was therefore not entirely representative of the supervisor's 
perception of the quality of his teachers, this posed no particular 
problem since it was not our intention to compare teachers from one area 
with those from another area. Instead, we wanted teachers who reflected 
a wide range of perceived teaching abilities. In addition, we wanted 
these teachers to be fairly evenly distributed throughout the state and 
to come from several different kinds of vocational schools with different 
kinds of students. The sample of teachers ultimately chosen fulfilled 
these criteria. 

Instruments 

While traditional interaction analysis instruments (e.g., the ones 
developed by Flanders, Galloway, etc.) could be used to record teaching 
behavior in the classroom situation, it became readily apparent that the 
observational method devised for the shop sessions precluded the use of 
these techniques. One of the reasons for this was the difficulty in 
recording data at such short time intervals. (Flanders, for example, 
recommends a three-second interval. 5) More importantly, though, it was 
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questionable whether the category systeips of the interaction analyses 
instruments reflected the kinds of activities that would best lead to 
our understanding of what constitutes effective communication in the 
shop situation. 

• Earlier, the suggestion was made that in analyzing the shop session, 
one important coramiunication variable might be the frequency of contacts 
the teachers makes with each individual student. In order to record this, 
an instrument was developed that allowed for coding each behavior accord- 
ing to its recipient, or in the case of a student initiating contact with 
the teacher, its initiator (Appendix E). Also, the duration of each contact 
lasting more than a half minute was recorded along with the instance of 
interaction.^ On some occasions the teacher contacted the entire clsss 
or small groups instead of individuals. A category was allowed for each 
of these type contacts. In addition, for each small group contact, a 
check was made of the individuals comprising the group. 

Since the use of praise and criticism by the teacher often serves 
as an index to the social -emotional environment in the classroom (i.e., 
the degree to which the student perceives the psychological atmosphere 
as non-threatening) as well as indicating the teacher's style of teaching, 
the inclusion of these communication variables seemed especially important 
Therefore, in addition to the number of contacts the teacher made, each 
instance of teacher praise or positive reinforcement and teacher criticism 
or negative reinforcement was also recorded. The purpose again was to 
identify not only the frequency of such behavior but also its recipient. 
Whenever the contact between the teacher and student consisted only of 
positive or negative reinforcement, it was coded twice--once as a contact 
and once as positive or negative reinforcement. This enabled an accurate 
recording of the total number of teacher- initiated contacts. 

In order to clarify the nature of positive and negative reinforce- 
ment, observers were required to record as accurately as possible exactly 
what the teacher said and to code it (as positive or negative reinforce- 
ment) in terms of its perceived impact upon the student (Appendix F). 
Nonverbal reinforcement behavior was also recorded since the teacher's 
facial expression alone often conveyed to the student an assessment of his 
(the student's) work. Despite the limitations of these classifications— 
we do not really know, for example, how each instance of praise or criticism 
is perceived by the student since such behavior probably interacts with 
a myriad of other factors in the teacher- student relationship— they do 
allow us to describe the nature and frequency of praise and criticism as 
used in the vocational shop. Hopefully, we will be able to relate these 
behaviors to other aspects of teaching in order to gain a better under- 
standing of communication in the teaching/ learning process. 

Another index of the social -emotional climate is the teacher's use 
of banter. In one of the earliest comprehensive studies of teacher effec- 
tiveness, Barr found that good teachers (as determined by supervisor ratings) 
performed more acts of laughing and smiling with the class than did poor 
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teachers.® Thus, a recording of both the number of instances of positive 
and negative reinforcement and banter provides some indication of the 
learning atmosphere created by the te&cher. 

After observing many shop sessions* it was found that another 
variable, the frequency and duration of interruptions, was also likely to 
affect the quality of teaching. On many occasions the teacher was engaged 
in nonteaching activities. Sometimes these activities were directly 
related to his work, e.g , checking and oidering supplies, conversing 
with administrators, counselors, and other teachers, etc. At other times 
the activities appeared not to be related. Included in this category 
would be personal phone calls, independent work on the teacher's own 
project, or non-scheduled work breaks. Instances and durations of 
interruptions were therefore recorded by the observer. An account was 
made also of the nature of the interruptions. 

The behaviors mentioned so far formed the basis for constructing 
the various indices for analyzing communication in the shop situation. 
While these behaviors and indices are by no means exhaustive, they reflect 
the macroscopic approach of the study and hopefully encompass the critical 
communication variables, ^s Figure 1 shows, each behavior was weighted 
according to the length of the shop session. For some indices, an addi- 
tional weighting was made for the number of students in the class. 

As an additional measure of the teacher's communication effectiveness 
in the shop, a rating scale was developed f Appendix G) . Based on the 
guidelines suggested by Becker,^ Reramers.^" and Kerlinger,^^ this instrument 
focused mainly upon organization and presentation skills. Also included 
was a rating of the kind of respect terms most frequently employed 
by the teacher. 

To give an even more complete picture of communication in the shop, 
the observer also noted the teacher's use of space and the specific 
activities for which he (the teacher) showed enthusiasm and gave praise 
(Appendix G) . Those activities for which the teacher did not show enthus- 
iasm or which prompted criticism were also recorded. Since it was reasoned 
that patterns of communication may vary according to the types of activities 
that take place, measures of the heterogenity of activities and the type 
of shop session were also included. F-inally, a five-step rating scale 
provided a rough indication of the general noise level in the shop. A 
much more sophisticated means of gauging noise level was considered; however, 
the expense of the instrument and the amount of time that would have to be 
devoted to administering it precluded its use. 

Following each shop session, the observer also provided a detailed 
narrative account of his perception of the activities that had taken place 
(Appendix G) . The main purpose of this account was to gain some impression 
of the distinguishing characteristics of the communication environment. 
For example, some shop sessions were particularly notable for the cleanliness 
or arrangement of the shop. Others were characterized by the tone set 
by the teacher, or the discipline of the students, etc. The narratives. 
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Index 



Method of Calculation 
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Number of teacher- 
initiated contacts 
per hour 

Number of teacher- 
initiated contacts 
per student per 
tour 

Number of minutes 
per hour of teacher- 
initiated contacts 
with students 

Number of minutes 
per student per hour 
of teacher-initiated 
contacts with students 

Average length of time 
(minutes) of teacher- 
initiated contacts 



Percentage of students 
contacted during shop 
session 



Total number of teacher-initiated 

contacts with students 

Total Shop time 

Total number of teacher-initiated 

contacts/number of students 

Total Shop time 



Total time of teacher-initiated 
contacts 



Total Shop time 



Total time of teacher- initiated 
contacts/number of students 
Total Shop time 



X 60 



X 60 



X 60 



X 60 



Total time of teacher-initiated 

contacts 

Total number of teacher-initiated 
contacts 

Total number of different students 
contacted during total shop time x 100 
Total number of students 
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Number of student - 
initiated contacts 
per hour 

Average number of 
student-initiated 
contacts per hour 

Number of minutes 
per hour of student- 
initiated contacts 
with teacher 



Total number of student -initiated 

contacts 

Total Shop time 

Total number of student -initiated 

contacts/number of students 

Total Shop time 

Total time of student-initiated 

contacts 

Total Shop time 



X 60 



X 60 



X 60 



Figure 1 .--Communication indices for the Shop situation 
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Index 


Method of Calculation 


Student -initiated con- 
tacts with teacher 


Average number of 
minutes per hour that 
students spent in 
their initiated con- 
tacts with teacher 

Average length of 
time (minutes) of 
student -initiated 
contacts 


Total time of student- initiated 
contacts/number of students y e.fy 


Total Shop time 

Total time of student -initiated 
contacts 


Total number of student- initiated 
contacts 


Combined teacher and student contacts | 


Number of teacher + 
student - ini t iat ed 
contacts per hour 

Number of teacher 
student- initiated 
contacts per student 
per hour 

Number of minutes per 
hour spent in teacher- 
initiated + st'iJeiit- 
initiated contacts 

Number of minutes per 
student per hour spent in 
teacher- initiated + stu- 
dent-initiated contacts 

Average length of time 
(minutes j oi teacner- 
initiated + student - 
initiated contacts 


Total number of teacher + student - 
initiated contacts y fin 


Total Shop time 

Total number of teacher + student- 
initiated contacts/number of 
students x fin 


Total Shop time 

Total time of teacher + student- 
initiated contacts v fin 
Total Shop time 

Total time of teacher + student- 
initiated contacts/number of 
students y fin 
Total Shop time 

Total time of teacher + student- 

Total number of teacher + student - 
initiated contacts 




Number of instances of 
positive reinforcement 
jper hour 


Number of instances positive 
reinforcement y fin 
Total Shop time 
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Y 
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Number of interrup- 
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therefore, served to fill in the coiiununication gaps, i.e., to explain 
the perceived important aspects of communication that we?-e not accounted 
for by the primary measuring instruments, and also to clarify more^ 
completely the measures that were obtained. This kind of information 
seemed especially important in an exploratory study. 

In many vocational programs, the formal classroom setting is 
utilized much less frequently than the shop. Nevertheless, it is often 
an important adjunct to the shop, for it provides a convenient place 
for sessions involving lecturing, group discussion, or problem solving. 
Since, to a great extent, the value of these type sessions depends 
upon the behavior of the teacher, an instrument was developed to determine 
the teacher's communication skills in the classroom situation as well 
as in the shop. Because of the numerous other instruments with which 
the observer had to cope and also because of the ease in administration, 
a rating scale similar to the one employed for the shop situation 
was used to tap classroom communication skills (Appendix H) . The items 
on these scales included certain delivery skills such as vocal rate, 
loudness, and fluency as well as other presentation and organization 
skills. 

For the classroom session also, an account was made of the 
general communication environment and the kinds of activities which 
provoked enthusiastic and unenthusiastic responses and praise and criticism 
from the teacher. A corroboration of these classroom skills with shop 
skills seemed especially worthwhile since many teachers in shop-type 
programs are likely to have had most of their experience in industry, 
which is similar to the shop setting, and less experience in the class- 
room or more formal education setting. Under such circumstances, we 
might suspect that teachers in these programs are more skillful 
communicators in the shop than in the classroom. 

Various other data were obtained which we believed might help 
to explain differences in teaching effectiveness. Among these were 
information about each teacher's education and experience, age, and 
ethnicity (Appendix I). We also had each teacher rank order twenty- 
nine attitudinal statements about school, the students, the status of 
teachers, etc. (Appendix J) These were analysed with both Q-and R-type 
analyses. The former was to discover whether different "types" of 
teachers could be identified based on the structure of their attitudes 
and, if so, whether "type" was related to teaching effectiveness. The 
R-analysis was a normal factor analysis whose results could be used to 
obtain measures of each teacher's attitudes on each attitudinal dimension. 
(The set of statements and analyses are described in greater detail 
later in this report.) 

Data from the preceding instruments constituted the measures of 
communication, teaching, and background which we believed could influence 
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or explain the effectiveness of vocational education teachers. In addition 
to these we used four measures of teaching effectiveness: 

1. Supervisor ratings on the five-item scales described earlier. 

2. Student ratings on a nine-item scale developed specifically 
for this study, but based in part on student rating scales 
used in other studies, (A copy of the scale can be seen in 
Appendix K.) 

3. Absentee rate of students. 

4. Drop rate of students. The rationale for this measure and the 
preceding measure is that the effectiveness of a teacher in a 
vocational program, we believe, is very closely tied to his 
ability to interest students sufficiently to attend class 
regularly and to stick with the course to its completion. 

Noticably absent from the various criteria that might be considered 
indicative of teaching effectiveness, in addition to supervisor and student 
ratings of the teacher, e:c., is any direct sjeasure of student achievement, 
the most important dependent variable in the teaching- learning process. 
Although we found no means that was appropriate, much time and effort 
was spent considering ways in which this information might have been 
obtained. One method, for example, would have been to have used an 
experimental approach. We might have atten^ted to devise a standardized 
unit of instruction for the shop and classroom session, controlled for 
individual differences in prior knowledge and learning ability and, 
following the session, measured student achievement. Complicating such 
an approach, however, was the fact that data were obtained from different 
kinds of vocational programs in which, while the activities were somewhat 
similar, the content vaijed according to the type of program. The experi- 
mental method would also have undermined one of our basic objectives: 
to obtain useful data in as unobtrusive a manner as possible, thereby 
allowing us to describe and analyze the communication environment as it 
actually existed. 

Several other criteria of student achievement were considered. Per- 
formance on the job, following the student's completion of a program, 
would provide ome indication of achievement. However, contacting employers 
about their perceptions of student performance wai; simply not feasible. 
Even if such information were readily available, some consideration would 
have to be made for individual differences among students and programs. 
Nevertheless, on-the-job performance is an important criterion and one 
which we would like to have included. 

Another way student achievement can be inferred is from licensing 
examinations which are taken following the completion of certain vocational 
programs. These examinations are standardized statewide and therefore 
provide some insight into the effectiveness of the teacher. Variations 
among students would again have to be considered. Unfortunately, none of 
the programs included in our study required a licensing examination. We 
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believe, however, that some type of standardized achievement test, despite 
the difficulty in developing it, would be extremely valuable in assessing 
and maintaining the quality of instruction in vocational education pro- 
grams. This kind of information combined with an employer's perception 
of students' on-the-job performance would constitute important criteria 
for gauging teaching effectiveness. 



Observers 



One of the most important preliminary aspects of the study was the 
selection and training of observers to collect the data. Since the 
measuring instruments included subjective as well as objective data, we 
believed that individuals trained in a communication discipline would be 
more perceptive, and hence, more skillful in their recording of communi- 
cation behavior. Subsequently, two graduates (one male and one female) 
of the Communication Arts program at the University of West Florida were 
employed and subjected to a rigorous training program. One of the observers 
had previously spent three months testing and refining the data gathering 
instruments and procedure and was therefore familiar with most aspects 
of the study. 

Following a brief orientation period, the two observers spent 
approximately four weeks observing and recording communication in various 
classroom and shop situations. (Teachers who participated in the training 
phase from these programs were not included in the study.) At ii^st, 
the objective was simply to familiarize the untrained observer with the 
various instruments and the standard procedure for administering them and 
to allow both observers to gain some experience in coding. During this 
period observers worked together so that variations in coding could be 
noted aiiJ resolved. For example, at times the teacher may have been 
talkinp to one student and interrupted momentarily. ("Momentarily was 
defined as less than a half minute.) In situations such as these, when 
the teacher's actions indicated that he was still maintaining contact 
with the former student, the decision was made to code that contact as 
a single interartion. 

Most of the coding problems were very minor and after the observers 
had gained sufficient experience in using the instruments, the next and 
most critical step was to establish intra- and inter-observer reliability. 
Also of importance, of course, is the reliability of the teacher, that 
is the degree to which his behavior remains consistent from day to day. 
Since we were using one male and one female observer, we were especially 
interested in the possible effects of sex differences on teacher and 
student behavior. 

Two kinds of data were used in computing reliability, and three 
types of reliability were recorded: 

1) reliability between the scores of different observers 
observing the same teacher at the same time. 
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2") reliability between the scores of the same observer observing 
the same teacher at different times. 

S) reliability between the scores of different observers observing 
the same teacher at different times. 

It should be noted that only the first type of reliability is a 
function of the observer alone. The other two tj-pes of reliability are 
partly a function of the teacher and partly a function of the observer. 

The first few weeks of training revealed that the main coding 
discrepancies in the shop concerned teacher- and student -initiated contacts. 
Since these behaviors constituted the majority of the data, reliability 
was first determined for these scores alone. Since this kind of record 
necessitated matching the recipients of the contacts, observers listed 
the students in a similar order on their coding form before they began 
collecting data. Tnis procedure facilitated computation. However, 
because the observer had to follow the teacher very closely during the 
shop session, it was difficult to determine whether an accurate measure 
of reliability was being obtained. In fact, it is probably safe to assume 
that observers often cued each other since it was almost impossible for 
one not to see the other's actions. For this reason, a more reliable 
method was devised. 

During the training program, videotapes of shop and classroom 
sessions were used in establishing referents for the various intervals of 
the organization and presentation scales. These tapes were also used 
to determine inter-rater reliability of teacher- and student -initiated 
contacts. The procedure was to allow one observer at a time to view 
the videotape and record the behavior. This method was judged as more 
reliable since it avoided the problem of cueing. Some reflection of 
this is found in the product -moment correlation measures. Whereas 
correlations using the former method were as high as .93, average 
correlations of the latter were .75. 

While the correlations of teacher- and student-initiated contacts 
indicate to what extent the recorded contacts are attributed to the same 
individual by each observer, they also indicate whether a contact noted 
by one observer is also noted by the other oiie. The latter factor is 
extremely important since many of the communication indices are based 
apon the total number of contacts. Results of the total teacher- and 
student- initiated contacts scores from the videotapes showed, however, 
that the average difference between observers in total number of contacts 
recorded was only two. The average time of the videotapes was 22 minutes, 
and the average number of contacts recorded was 40. In other words, there 
wos a variation in the number of contacts of approximately six an hour or 
approximately five for each hundred that v;ere recorded . 

Although the correlation of observers' simultaneous recordings 
of contacts in the shop was perhaps invalidated by a cueing effect, 
the scores of presentation and organization skills, based on the same 
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session, could still be used in establishing reliability since these 
ratings were determined privately immediately following the shop 
session. Product -moment correlations between observers' ratings of 
these skills ranged from .66 to 1.00. The average correlation was .87. 

Following the videotape practice session, observers began working 
alone, spending two consecutive days with each teacher. The purpose of 
these observations was to determine in part the degree to which the 
teacher's behavior varied from day to day. Confounded in this, of 
course, is the reliability of the observer. Correlations of the two 
days' observations were derived from the communication indices' scores. 
Use of these indices, however, necessitated a non -parametric correlational 
technique. Therefore, in establishing the relationship between scores 
of observations made by the same observer at different times and scores 
of observations made by different observers at different times, Scott's 
coefficient ( n } was used.^^ Xable I shows the pi coefficients for 
two teachers observed during the training period. 

Medley and Mitzel note that a third kind of correlation, which 
they call the "reliability coefficient," is necessary to gauge more 
accurately the behavior being measured. Whereas the correlation 
between scores based on observations made by different observers at the 
same time involves only a limited sampling of behavior and the correla- 
tion between scores based on observations made by the same observer at 
different times is most likely to reflect the observer's biases, the 
other kind of correlation, based on observations made by different observers 
at different times, gives us the best indication of whether the data reflect 
accurately the teacher's behavior. This information is shown in Table II. 

The greatest variations occurred in the amount of time spent 
by the teacher in his initiated contacts with the students and the amount 
of time spent in combined teacher- and student -initiated contacts. 
For one of the teachers, there was al'-^o a substantial difference in the 
time of interruptions. Whereas the first day's interiuptions averaged 
14 minutes per hour, the second day's interruptions averaged 34 minutes. 

None of the differences found in Table II or for similar instances 
in which observations were made by different observers at different times 
seemed attributable to the sex of the observer. IVhile it is likely that 
the intrustion of a visitor probably caused all teachers to become 
slightly more energetic, it did not seem to matter whether the observer 
was a male or female. 

One of the most difficult problems in assessing teacher behavior 
is determining the sampling unit of time. To state the problem another 
way, how long must a teacher be observed before his overall teaching 
behavior can be characterized accurately or reliably? 
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TABLE I 



MEASURES AND RELIABILITY COEFFICIENTS BASED ON OBSERVATIONS OF THE 
SAME TEACHER BY THE SAME OBSERVER ON DIFFERENT DAYS 





Teacher 1 
1st day 2nd day 
(Same observer) 


Teacher 2 
1st day 2nd day 
(Same observer) 


initiated contacts 
per hour 


22.2 21.6 


10.9 15.8 


Number of teacher- 
initiated contacts 
per student per 
hour 


1.5 1.5 


2.2 1.8 


Number of minutes 
per hour of teacher- 
initiated cont act s 
with students 


13.2 14.4 


25.9 41.4 


Number of minutes 
per sruuenr per nour 
of teacher'-inHiated 
contacts with stu- 
dents 


.9 1.0 


5.2 4.6 


Average length of 
time (minutes) of 
t eacher - ini t i at ed 
contacts 


.6 -7 


2.4 2.D 


Percentage of stu- 
dents contacted 
during shop session 


100 100 


100 100 


Number of student- 
initiated contacts 
per hour 


8.1 9.3 


2.7 4.7 


Average number of 
student- initiated 
contacts per hour 


.5 .6 


.5 .5 
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TABLE I —Continued 





Teacher 1 
1st day 2nd day 
(Same observer) 


Teacher 2 
1st day 2nd day 
(Same observer) 


Number of ininutes 
per hour of student - 
initiated contacts 
with teacher 


.7 .7 


1.7 2.6 


Average number of 
minutes per hour 
that students spent 
in initiated contacts 
with teacher 


.1 .1 


.3 .3 


Average length of 
time (minutes) of 
student - ini t iat ed 


.1 .1 


.6 .6 


Number of teacher + 
student -initiated 
contacts per hour 


30.3 31.0 


13.6 20.4 


Niimhf^'T of teacher + 
student- init iat ed 
contacts per student 
per hour 


2.0 2.0 


2.7 2.3 


Number of minutes 
per hour spent in 
t eacner- mi 1 1 at ea 
+ s t udent - in i t i at ed 
contacts 


13.8 15.1 


27.6 44.0 


Number of minutes 
per student per 
hour spent in 
teacher- init i at ed 
+ student-initiated 
contacts 


.9 1.0 


5.5 4.9 
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TABLE I— Continued 





Teacher 1 
1st day 2nd day 
(Same observer) 


Teacher 2 
1st day 2nd day 
(Same observer) 


Average length of 

time (minutes) 

of teacher-initiated 

♦ student-initiated 

contacts 


.5 


.5 


2.0 


2.0 


Number of instances 
of positive rein- 
forcement per hour 


19.8 


21.4 


10.9 


7.5 


Number of instances 
of negative rein- 
forcement per hour 


4.7 


5.2 


2.2 


4.1 


Total number of 
instances of rein- 
forcement (positive 
and negative) per 
hour 


24. S 


26.6 


13.1 


11.6 


Positive/Negative 
reinforcement ratio 


4.2 


4.1 


5.0 


1.8 


Number of instances 
of banter per hour 


3.4 


2.7 


4.4 


2.1 


Number of inter- 
ruptions per hour 


1.6 


.8 


3.9 


2.8 


Number of minutes 
per hour spent 
in interruptions 


2.0 


1.6 


8.6 


10.6 


Average length of 
time of interrup- 
tion 


1.3 


2.0 


2.2 


3.7 



TT = .94 TT = .70 
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TABLE II 



NEASURES AND RELIABILITY COEFFICIENTS BASED ON OBSERVATIONS OF THE 
SAME TEACHER BY DIFFERENT OBSERVERS ON DIFFERENT DAYS 







^ 




Teacher 1 
1st day 2nd da> 
Lst Observer 2nd Observer 


Teacher 2 
1st day 2nd day 
1st Observer 2nd Observei 


NuHiber of teacher* 
initiated contacts 
per hour 


24.7 21.4 


12.0 


16.5 


Number of teacher- 
initiated contacts 
xi&T Student oer 
hour 


1.4 1.1 


.8 


1.1 ' 


Number of minutes 
per hour of teacher- 
initiated contacts 
with students 


26.1 13.2 


24.0 


14.4 


Number of minutes 
per student per 

initiated contacts 
with students 


1.5 .7 


1 • 0 


1 n 


Av^Taffe lenffth of 
time (minutes) of 
teacher- ini t iat ed 
contacts 


1.1 .6 


2.0 


.9 


Percentage of 
students con- 
tacted during 
shop session 


95 94 


80 


50 


Number of student - 
initiated contacts 
per hour 


3.3 5.5 


8.9 




Average number of 
St uden t - in i t i at ed 
contacts per hour 


.2 .3 


.6 


.4 
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TABLE II— Continued 



Teacher 1 I Teacher 2 

1st day 2nd day 1st day 2nd day 
list Observer 2nd Observer} 1st Observer 2nd Observer 



Number of minutes 
per hour of student- 
initiated contacts 
with teacher 

Average number of 
minutes per hour 
that students spent 
in initiated con- 
tacts with teacher 

Average length of 
time (minutes) of 
student-initiated 
contacts 

Number of teacher •< 
student- initiated 
contacts per hour 

Number of teacher + 
student - in it iated 
contacts per stu- 
dent per hour 

Number of minutes 
per hour spent in 
teacher- in it i at ed 
+ student- initiated 
contacts 

Number of minutes 
pr-* student per 
hour spent in 
teacher- initiated 
+ student -initiated 
contacts 



.9 



.1 



.2 



.2 



.1 



.0 



.0 



.3 



27.9 



.0 



26.9 



.0 



21.9 



.0 



22.7 



1.6 



1.4 



1.3 



1.5 



27.0 



13.2 



24.0 



14.4 



1.5 



.7 



1.5 



1.0 



28 



TABLE 1 1 --Continued 







r 














Teacher 1 
1st day 2nd day 
1st Observer 2nd Observer 


Teacher 2 
1st day 2nd day 
1st Observer 2nd Observer 


Average length of 
time (minutes') cf 
teacher-- initiated 
^ student- initiated 
contacts 






1.2 


.6 


Number of instances 
of positive rein- 
forcement per hour 


.9 


.0 


.4 


.4 • 


Number of instances 
of negative rein- 
forcement per hour 


K2 


.5 


2.7 


Z , i. 


Total number of 
instances of rein- 
forcement (posi- 
tive and negative) 
per hour 


2.1 


.5 


3.1 


2.7 


Pos i t ive/Negat i ve 
reinforcement ratio 




.5 


.2 


.2 


Number of instances 
of banter per hour 




5.8 


4.0 


4.0 


Number of inter- 
ruptions per hour 




5.8 


3.6 


2.2 


Number of minutes 
per hour spent in 
interruptions 


14.1 


34.3 


14.4 


13.8 


Average length of 
time of interrup- 
tion 


5.7 


6.0 


4.1 


6.2 



Tt = .55 n = .70 
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Two of the types of correlations provide some insight into the day- 
to-day variations of a teacher's behavior. While many of his behaviors 
as reflected by the communication indices remained quite consistent, 
especially those, as one might expect* relating to presentation and organi- 
zation skills, several of the shop indices revealed that the uniqueness 
of each day*s activities caused &ome fluctuation in the time the teacher 
devoted to various chores. In some instances this fluctuation might be 
manifested in the amount of time spent in direct contact with the student, 
which in turn, might affect the amount of praise and criticism used. 
Therefore, in order to obtain a more reliable measure of the teacher's 
behavior, the decision was made to spend two days with each teacher and to 
average the data accordingly. (Reliability coefficients on first and 
second day's data are reported in the Results sect ion. ) 

While we had already intended to allow the observer to spend two 
days with a teacher, wc thought that it would take one day for the observer 
to familiarize nimself with the surroundings and to practice gathering 
data. It beca,Tie apparent quite soon, however, that the observers were 
able to orient themselves in a very short time, thus enabling the record- 
ing of both days' behavior. The average time of observation (shop and 
classroom) during the training period was between four and six hours, a 
figure which compares favorably with the time interval of other classroom 
communication studies. 

Once the reliability data were deemed satisfactory, observers were 
ready to go into the field. As an additional precaution, however, in order 
to control as much as possible potential effects of different observers 
on obtained differences among types of teachers, we assigned one observer 
to the northern part of Florida and the other to the southern part, know- 
ing that each section contained -relatively the same number of teachers 
and same types of programs, and that no comparison would be made between 
teachers from one part of the state with teachers from another part. 

Once a sufficient number of the supervisor ratings of teachers had 
been obtained, a list of names was compiled and given to the observers 
along with the name of the designated contact person. Whenever the observer 
moved from one area to the next, he (or she) would usually spend the first 
day making arrangements (through the appropriate contact) with each teacher 
for the two days of observation. No attempt was made to conceal the nature 
of the study; however, observers were instructed to minimize their contact 
with the teacher and to give only a general briefing on the purpose of the 
study. The idea was to play down the "evaluation" aspects since in fact 
the data were for research purposes only. Because of this approach and 
the fact that, as stated previously, each teacher was assured anonymity, 
most teachers agreed to participate in the study. 

Observers arrived before each shop or classroom session began and 
after orienting themselves, recorded the time and began collecting data. 
If a coffee break or a lunch break occurred, the observer again recorded 
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the tirae and stopped collecting data for the duration of the break. 
Also, whenever the session was supposed to be over (at the designated 
tiK*), the observer stopped collecting data in spite of the fact that 
some teachers often continued working with individual students beyond 
the regular ending time. If such an occurrence seemed notable, it 
was recorded in the narrative. Likewise, whenever a teacher dismissed 
his students early and the incident seemed to reflect the teacher's 
attitude, this information as well was included in the narrative 
description. 

At the end of each day's observation, the observer filled out the 
rating scale instruments and completed the forms that called for descriptive 
data. On the second day, toward the end of the session, he (or she) 
administered the teacher Q-sort and the student questionnaire. Sometimes, 
however, these instruments, and the form that furnished background informa- 
tion about the teacher and his program, had to be administered at a time 
that was more convenient to the teacher. 

Observers mailed their data to the project office approximately 
every two weeks. A WATS line enabled one of us to contact the observers 
often and to resolve quickly any irregularities that might have been 
found, e.g., missing data. It also allowed us to resolve any other 
problems that might have arisen. We discovered, for example, that a 
number of teachers were team-teaching. Since this arrangement could 
not be accounted for by the measuring instruments we had devised, we 
had to omit from study teachers who had been selected but who were 
teaching in that kind of situation. The only other recurring problem 
was scheduling. Holidays, special school activities, or illness of 
the teacher sometimes forced the observers to rearrange their observa- 
tion schedules. Despite these impediments, we were able to gather 
data from 124 teachers over an eight month period. 
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FOOTNOTES 



^Donald M. Medley and Harold E. Mitzel, "Measuring Classroom 
Behavior by Systematic Observation," in Handbook of Research on Teaching , 
ed. by N. L. Gage (Chicago: Rand McNally and Company, 1963), p. 248. 

^ Florida's Public Education Program (Tallahassee: Florida 
Department of Education, 1971-72), p. 57. 

^Also excluded ' 'om study were teachers in the Manpower Development 
Training programs. While the activities of these teachers were not neces- 
sarily different from the kinds of activities that take place in other 
programs, we decided to omit from study teachers in unique programs such 
as the exemplary and MDT in order to avoid possible extraneous influencing 
factors. 

^ Industrial Education: Directory of Schools and Courses (Tallahassee, 
Florida Department of Education, 1972). 

^Ned A. Flanders, Analyzing Teaching Behavior (Reading, Mass.: 
Addison-Wesley Publishing Company, 1970), p. 37. 

^A half minute was found to be a convenient unit of time for the 
observer to note the duration of a contact and still be able to record 
fully other aspects of communication, e.g., the use of banter, praise, 
criticism, etc. 

^For an early account of the social-emotional classroom environment, 
see John Withal, 'The Development of a Technique for the Measurement of 
Social -Emotional Climate in Classrooms," in Interaction Analysis: Theory, 
Research, and Application , ed. by Edmund J. Ami don and John B. Hough 
(Reading, Mass.: Addison-Wesley Publishing Company, 1967), pp. 47-64. 

^An account of this study is found in Medley and Mitzel, pp. 258-59. 

^Samuel L. Becker, "Rating Scales," in Methods of Research in 
Communication , ed. by Philip Emmert and William Brooks (New York: Houghton 
Mifflin Company, 1970), pp. 213-235. 

^°H. K. Remraers, "Rating Methods in Resoarch on Teaching," in 
Handbook of Research on Teaching , pp. 329-378. 

^^Fred N. Ker linger. Foundations of Behavioral Research (2nd ed.. 
New York: Holt, Rinehart and Winston, 1973), pp. 546-549. 

^'^William A. Scott, "Reliability of Content Analysis. The Case of 
Nominal Scale Coding," Public Opinion Qtiarterly , XIX (Fall, 1955), 321- 
325. 
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l^ledley and Mitzel, pp. 256-264. 



^^A one and a half to two hour observation period was used in a 
study by C. V. Robbins, "The Principal and His Knowledge of Teacher 
Behavior/' in Interaction Analysis: Theory, Research, and Application » 
ed. by Hdmund J. Amidon and John B. Hough, p. 178. Four "class sessions" 
constituted the time unit for the study by Bel lack et_ al.. Amo A. 
Bellack, Herbert M. Kliebard, Ronald T. Hyman, and Frank L. Smith, Jr., 
The Language of the Classroom (New York: Teachers College Press, 1966), 
p. 11. Loepp used two "class periods" in his study. Franzie Lee Loepp, 
"The Development of a System to Analyze Teacher-Student Interaction in 
Junior High School Industrial Arts Classrooms" (unpublished doctoral 
dissertation, University of Northern Colorado, 1971), p. 28. In another 
study of vocational education teachers, Kruger scheduled "three observa- 
tion periods" for each teacher. John M. Kruger, "Interaction Patterns 
of Indsutrial Arts Teachers in Laboratory Type Situations at the Junior 
High School Level" (unpublished doctoral dissertation. University of 
Colorado, 1971), p. 26. 
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RESULTS 



Description of Subjects 

All the teachers observed in this study were male and came from a 
variety of Industrial Education programs. Table III shows that almost 
half the sample was comprised of Auto Mechanics and Air Conditioning and 
Heating Mechanics instructors while another third were in either Auto 
Body Repair, Machine Shop Work, or Welding. The majority of the remaining 
instructors were in other mechanics -type programs: Aviation Mechanics, 
Gasoline Engine Mechanics, Marine Engine Mechanics, Diesel Mechanics, 
or Diversified Mechanics. Only one instructor was selected from each of 
the other programs: Agricultural Mechanics, Millwork Shop, Plumbing, 
and Sheet Metal. The reason that so few t«iachers were represented in the 
latter programs is that they comprise only a small proportion of the 
Industrial Education programs in the state. 

The programs were located in three types of schools (Table IV) ;^ 
however, in some cases secondary school classes were bussed to a vocational- 
technical center. For situations such as these, we designated the teacher 
as having come from a secondary school. 

Table V shows a breakdown of teachers according to age. While the 
mode fell in the 50-59 year old interval, the average age of the teachers 
was 47. Despite a relatively high mean age, the majority of teachers had 
less than five years teaching experience (Table VI). One explanation for 
this is that practical experience is such an important prerequisite for 
teaching in these type programs; consequently, older persons are likely 
to have had more work experience and are therefore more likely to be 
"qualified" to teach. Some evidence of the relationship among age, 
teaching experience, and practical experience is found in Table VII. 
Although the correlation between age and teaching experience was .40, 
for all age categories except the last one (60-69), the mode of teaching 
experience fell in the 0-5 year interval. 

The mode for prat :ical experience also varied according to age 
(r = .55). Most teachers under 30, as might be expected, had less than 
10 years practical experience. The majority of teachers between 30 and 
39 had 10-19 years of practical experience whereas the majority of teachers 
in the age category 40-49 had 20-29 years of practical experience. The 
mode for teachers in the next age category, 50-59, also fell in the 20-29 
year work experience category. In the last age interval, 60-69, an equal 
number of teachers was found in the lotter three categories of practical 
experience. No teacher in this age group had less than 10 years practical 
experience. 
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TABLE III 

NUMBER OF TEACHERS FROM EACH INDUSTRIAL EDUCATION PROGRAM 



Program 


Number 


of Teachers 


Per cent 






(N=124) 




Auto Mechanics 




35 


28 


Air Conditioning and 








Heating Mechanics 




22 


17 


Auto Body Repair 




15 


12 


Machine Shop Work 




12 


10 


Welding 




12 


10 


Aviation Mechanics 




8 


6 


Gasoline Engine Mechanics 




7 


6 


Marine Engine Mechanics 




4 


3 


Diesel Mechanics 




3 


2 


Diversified Mechanics 




2 


2 


Agricultural Mechanics 




1 


1 


Mi 11 work Shop 




1 


1 


Plumbing 




1 


1 


Sheet Metal 




1 


1 




TABLE 


IV 




NUMBER OF TEACHERS FROM 


EACH TYPE OF SCHOOL 






School 


Number 


of Teachers 


Per cent 






(N=124) 




Secondary School 




47 


38 


Vocational -Technical Center 


55 


44 


Community College 




22 


18 



35 



TABLE V 
AGE OF TEACHERS 



Age interval 


Number (N = 124) 


Per cent 


20-29 


8 


7.0 


30-59 


19 


15.0 


40-49 


43 


35.0 


50-59 


45 


36.0 


,60-69 


9 


7.0 




TABLE VI 






TEACHING EXPERIENCE 




(in years) 


Number of Teachers 
(N = 124) 


Per cent 


0-5 


DCS 




6-11 


34 


27 


12 - 17 


8 


6 


18 - 23 


6 


5 


24 - 29 


6 


5 


30 - 35 


2 


2 



Average number of years of teaching experience = 7.5 years 
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TABLE VII 



NUMBER OF TEACHERS ACCORDING TO AGE, PRACTICAL (WORK) EXPERIENCE, 

AND TEACHING EXPERIENCE* 

Teachers 20-29 years old 



Practical Experience 


Years of Teaching Experience 




0-5 6-11 12-17 18-23 24-29 30-35 


Less than 10 years 
lO-less than 20 
20- less than 30 
50 years or more 


5 

2 1 


Teachers 30-39 years old 


Practical Experience 


Years of Teaching Experience 




0-5 6-11 12-17 18-23 24-29 30-35 


Less than 10 years 
10-less than 20 
20- less than 30 
30 years or more 


3 1 
12 
3 


Teachers 40-49 years old 


Practical Experience 


Years of Teaching Experience 




0-5 6-11 12-17 18-23 24-29 30-35 


Less than 10 years 
10-less. than 20 
20- less than 30 
30 years or more 


1 1 

4 5 2 
16 6 1 2 1 

2 1 1 
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TABLE VII— Continued 



Teachers 50-59 years old 



Practical Experience 


Years of Teaching Experience 




0-5 6-11 12-17 18-23 24-29 30-35 


Less than 10 years 
10- less than 20 
20-les«; than 30 
30 years or more 


1 1 
2 3 11 

8 10 2 1 1 

9 4 1 


Teachers 60-69 years old 


Practical Experience 


Years of Teaching Experience 




0-5 6-11 12-17 18-23 24-29 30-35 


Less than 10 years 
10-less than 20 
20- less than 30 
50 years or more 


2 1 
1 1 1 
1 1 



♦The correlation between age and practical experience was .55. 

The correlation between age and teaching experience was .40. 

The correlation between practical experience and teaching experience 
was .09. 
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The low correlation between practical experience and teaching 
experience (r = .09) is reflected in the table. Of the 68 teachers 
who had less than five years teaching experience, the mode for practical 
experience fell in the 20-30 year category. For the 35 teachers who 
had 6-11 years teaching experience, the mode for practical experience 
was also found in the 20-30 year category. 

Approximately half the teachers in the sample had only one year 
or less of education beyond the secondary school level (Table VIII). 
Perhaps because of the availability of college level courses, community 
college teacher had on the average more years of academic work than did 
teachers in the secondary schools or the vocational -technical centers. 
For all teachers, the average number of vocational courses taken was 
eight. Teachers had in addition to the vocational courses an average 
of one course each in psychology and communication. 

Only seven per cent of the teachers in our sample were black 
(n = 9). The majority of them taught in either Auto Mechanics or Auto 
Body Repair programs. Of the nine black teachers, seven were found in 
secondary schools and two in vocational -technical centers. While no 
black instructors cfime from community colleges, that type school included 
the smallest proportion of teachers in the sample (18%). 

Average age and practical experience of the black teachers were 
approximately the same as the averages for the entire sample; however, 
black teachers averaged almost 16 years of teaching experience, over 
twice the amount for all teachers (7.5 years). They also reported an 
average of 5.7 years schooling beyond the secondary level, a figure 
which again was almost twice the sample average (1.9 years). 

The entire sample of teachers had taught at their present school 
an average of 4.3' years. Twenty of the teachers (16%) had been there for 
only a year or less. These teachers resembled the entire sample in terms 
of work experience, age, and formal education. However, they had approxi- 
mately three fewer years of teaching experience. In fact, half of them 
were in their first or second year of t<?aching. The average age of 
these teachers (40) was less than the average for the entire sample. 
Also, these teachers had slightly less practical experience (19 years) 
than the entire sample. They averaged one year of formal education 
beyond the secondary level, and 90 per cent of them (9) were white. 

Based on the preceding information, the following conclusions 
were drawn about the teachers who were observed. 

1. Over two-thirds of the teachers observed were from mechanics - 
type programs. Most of the other teachers came from Auto Body Repair, 
Machine Shop Work, and Welding. 

2. The largest percentage of teachers were located in vocational- 
technical centers. A relatively similar percentage came from secondary 
schools, while less than 20 per cent of the fr^^chers came from community 
colleges. 
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TABLE VI n 
ACADEMIC BACKGROUND OF TEACHERS 





Secondary 
School 
(n = 47) 


Vocational - 
Technical 
Cn = 55) 


Community 
College 
(n = 22) 


Years of education 
beyond secondary 
level 


Number 


Per cent 


Number 


Per cent 


Number 


• 

Per cent 




0 


11 


23 


16 


29 


3 


14 




1 


12 


26 


15 


27 


3 


14 




2 


5 


11 


12 


22 


9 


41 




3 


7 


15 


5 


9 


4 


18 




4 


3 


6 


4 


7 


2 


9 


more 
than 


4 


9 


19 


3 


6 


1 


4 



40 



3. The teacher's age was related to the number of years of 
practical experience (r = .55) and also to the number of years of 
teaching experience (r = . 40) . 

d. Despite an average age of 47, the majority of teachers had 
less t:->un five years teaching experience. 

5. One-fourth of the teachers in oar sample had no formal 
education beyond the secondary school level;^ Another fourth had at 
least one year of higher education, while 10^per cent had more than 
four years. Community college teachers averaged more years of formal 
education than teachers from either the vocational -technical centers 
or the secondary schools. v 

6. Teachers had an average of eight vocational courses and 
one course each in psychology and communication. 

7. Seven per cent of the teachers in the sample were black> 
and the majority of them taught in either Auto Mechanics or Auto Body 
Repair programs. The black teachers had about twice as much teaching 
experience and formal education as the entire sample. In all other 
respects, e.g., age, practical experience, etc., the black teachers 
approximated the average for the entire sample. 

8. Teachers had been in their present location for an average 
of four and a half years. 

9. Ten teachers were in their first or second year of teaching. 
These teachers were somewhat younger than the average for the entire 
sample and had slightly less work experience. 

Reliability of Measures 

To determine which measures of communication were most consistent 
from day to day, and hence most reliable, we compared the data from the 
first day's observation with that from the second. A correlation 
coefficient was computed for each item from the communication measuring 
instruments. The computation was based on all teachers* scores on the 
first day (for a particular item) compared to their scores on the second 
day. 

Results of the correlation analyses showed that the shop communica 
tion measures involving teacher and student contacts were fairly reliable 
Highest coefficients were obtained for the number of teacher- and student 
initiated contacts per hour (.74) and the number of teacher- and student - 
initiated contacts per hour adjusted for the number of students in the 
class (.73). The average number of student-initiated contacts also 
showed a high correlation (.69) as did the number of teacher- initiated 
contacts per student (.60). The measures involving the average time of 
these contacts were less reliable. 
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The indices of reinforcement behavior were also fairJ^ reliable, 
ranging from -58 to .69. The highest correlation was for the number of 
instances of positive reinforcement per hour; and the lowest was for the 
number of instances of negative reinforcement. Interestingly, though 
each of these two measures of reinforcement is relatively reliable, they 
do not correlate well with each other--only .11. (This latter correlation 
is based on the combined data from both days.) 

While the number of instances of banter proved to be highly 
reliable (r = .80), the measures of interruption and percentage of 
students contacted were much less so. Correlations for the interruption 
measures ranged from .59 (average number of interruptions per hour) to 
.22 (average length of interruptions). The correlation for percentage 
of students contacted was .34. 

The reliability of the rating scale items for the shop session 
was excellent, though this may have been due in part to the fact that 
the observers remembered from one day to the next how they assessed 
the teacher's skills. Correlations for these items ranged from .54 to 
.86. The correlations for the percentage of time the teacher kept an 
obstacle between himself and his student and the noise level in the 
shop were also relatively high (.68 and .73). Items comprising the 
classroom rating form were less reliable than the shop items. The 
highest correlation was for fluency , )1), and the lowest was for 
appearance of self-confidence (.28). 

Another way in which we examined reliability was to correlate each 
teacher's scores of the first day (on all communication items) with his 
scores on the second day. In performing these analyses, we used only 
the 24 shop communication indices since they were the measures that were 
least likely to have been affected by observer recall. Also, instead 
of using a non*- parametric correlation technique as we did during the 
training phase of our stud^^ we normalized the data (using the sample 
mean and standard deviation of each item as a basis for transformation) 
and performed product -moment correlations. 

Of the 121 coefficients obtained (for the 121 teachers who had 
shop sessions on both days), 78 of them (64.5%) were positive and 
significant at the .05 level of confidence. The correlations ranged 
from .98 to -.47; however, only six were negative. Approximately half 
the coefficients (59) were -60 or higher. Based on the analyses of the 
separate items, we would suspect that the non-significant correlations 
were due mainly to the variability of those items concerning duration 
of contacts, interruptions, and percentage of students contacted. 

IVhile the reliability data presented in this section were not 
obtained by comparing the scores of one two-day observation period with 
those of another (the best means of testing the reliability of our data), 
they nevertheless give some indication of the consistency among the 
various communication measures and suggest the fruit fulness of our 
using the two-day period for collecting data. Perhaps in a future 
study we can determine more precisely the degree to which precision 
(reliability) is increased by extending the observation period. 
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Construction of Indices 



In order to further increase the reliability of our communication 
measures, the data generated by each instrument were subjected to a factor 
analysis.^ An orthogonal rotation was used, and based on tl.e factor 
scores items were combined into various communication indices. The 
same procedure was used for the teacher attitude measure. 

Shop Communication Skills . The results of the factor analysis 
of the 24 shop communication measures are s'.iown in Table IX. Eight 
factors were generated, although for three of the factors only one 
item had a heavy loading. The first factor was comprised of six items, 
each of which concerned the number of contacts (and number of contacts 
per student) made by teachers and students. Since the contact scores 
for teachers and students were combined in the last two items, we used 
these as our index and omitted the other four items. We labelled this 
factor "Teacher and Student Contacts." 

The second and third factors showed that the duration of teacher- 
and student- initiated contacts loaded on different factors. Therefore, 
we chose as an index of "Teacher Contact Time" the first two items 
(number of minutes of teacher- initiated contacts and number of minutes 
per student) on the second factor. For the index of "Student Contact 
Time" we selected the three items (number of minutes of student -initiated 
contacts, average number of minutes, and average length of contacts) 
that loadei heaviest on the third factor. 

We called the fourth factor the "Positive Reinforcement" index. 
The items comprising this index were: 1) number of instances of positive 
reinforcement per hour; 2) the positive/negative reinforcement ratio; 
and 3) banter. 

Only one item had a pure loading on the fifth, sixth, and seventh 
factors. The item for the fifth factor was the number of interruptions 
per hour, while the item for the sixth was the number of instances of 
negative reinforcement per hour. The seventh factor was comprised of 
the average length of time of teacher- and student -initiated contacts. 

The last factor was labelled the "Interruption Time" index and 
was comprised of the average length of time of interruptions and number 
of minutes per hour spent in interruptions. While some items, such as 
the last one, had no pure loading and were therefore not included in 
any of the combined indices, they were retained and included in a later 
analysis. 

To derive the raw score for an index, the data were first normalized 
using the sample mean and standard deviation of each item as the basis for 
transformation. The normalized data of each item in the index were then 
added together to yield the raw score. 
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Items from the rating scale were also subjected to a factor 
analysis; however, because so few teachers had a classroom session, 
only the shop items and those concerning presentation skills were 
included in the analysis. ^ The reason that the latter items were included 
was that delivery skills were assessed regardless of whether a classroom 
session was held. 

Table X shows the two factors that emerged from the analysis. 
The first factor was labelled Dynamism and the index was comprised of 
the following items: 1) keeps everyone busy; 2) general vigor and 
enthusiasm; 3) skill at clarifying directions; 4) appearance of self- 
confidence; and 5) ability to create proper social -emotional environment. 
The other factor was labelled Delivery since it was comprised of the 
various aspects of vocal quality: 1) loudness; 2) vocal rate; 3) fluency; 
and 4) vocal variation. The last two items, bodily action (gesture and 
eye contact) and appropriateness of language had the lowest and most 
evenly divided factor loadings; therefore, for our various analyses 
these items were analyzed separately. 

Responses to the Teacher Q-Sort Instrument . The statements 
which tcache^rs rank ordered provided for two types of analyses. First, 
we performed a Q-factor analysis to identity types of teachers {according 
to their attitude towards various aspects of teaching) and to ascertain 
whether teacher-type was related to communication behavior or the various 
measures of teaching effectiveness. We found, however, no evidence to 
support this notion. (An explanation of the Q-analysis is presented 
in Appendix L.) Therefore, we did an R-factor analysis of the Q-sort 
items and used the results of this analysis to determine the relationship 
between various dimensions of teacher attitude and our teaching effective- 
ness criteria. This procedure, as v.'iil be shown later, proved to be the 
more fruitful approach to understanding the relationship between the 
teacher's attitude and his ef tectiveness as a teacher. 

As the table of moan scores on the Q-sort items shows (Table XI), 
responses to most of the attitude items in the instrument appear to be 
pretty well distributed, indicated by the fact that the means of most of 
them cluster in the 10 to 15 range (on a 1 to 24 possible range). The 
four items most disagreed with show negative attitudes toward the students 
("The primary function of this school is to keep these kids off the 
streets and out of trouble" and "Students in this school generally 
tend to be misfits") and a dislike of teaching ("If I could earn as much 
money in another occupation, I would stop teaching" and "If I could 
plan my career again, I would not choose teaching"). Note, however, 
that the mean scores for these items are not especially high--15.3 to 
16.2--which indicates that the majority of teachers did not select these 
items as the ones they most disagreed with. 

The items most agreed with are almost mirror images of those most 
disagreed with. The highest ranked items are "Teaching gives me a great 
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TABLE X 

FACTOR ANALYSIS OF ORGANIZATION AND PRESENTATION SKILLS 



N = 123 


ractor 1 


raCXOT 4 


Keeps everyone busy 


.05 




General vigor and 
enthusiasm 






Skill at clarifying 
directions 


.45 


-.66* 


Appearance of self- 
confidence 


.45 


-.65* 


Ability to create 
proper social-emotional 
environment 


.02 


-.80* 


Loudness 


.83* 


-.16 


Rate 


.86* 


-.08 


Fluency 


.71* 


-.19 


Vocal variation 


.79* 


-.33 


Bodily action 


.59* 


-.43 


Appropriateness of 
language 


.20 


-.35* 



*Loads heaviest on this factor 
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deal of personal satisfaction," "I find my contacts with students, 
for the most part, highly satisfying and rewarding," "To me there is 
no more challenging work than teaching," and "T feel reasonably 
successful in my present position." The mean scores for these state- 
ments ranged from 4.3 to 5.9, which Indicates that most teachers did 
rank them at or near the "Most agree with" end of the continuum. 

Thus it appears clear that the level of satisfaction v-ith 
teaching and with the students in these schools is reasonably high. 
Whether it is higher than that which one would find among any group 
of secondary school and junior college teachers or among teachers in 
other types of vocational programs we cannot say, of course, on the 
basis of the data from this study, since ve did not gather information 
from teachers other than those in Industrial Education programs. 

Three factor analyses were made of these data in order to 
estimate the dimensions of attitude represented in the particular 
items used. For each analysis the minimum eigen value was set at 
2.2 and a varimax rotation was used. Three, five, and ten-factor 
solutions were obtained. On the basis of the relative independence 
of factors, the amount of variance accounted for, and the face 
validity of factors, we decided that the five-factor solution was 
the best one. The factor structure is shown in Table XII. For 
each factor, the items are listed in rough order from those which 
most clearly define the factor to those which least clearly do so. 
This ranking is based not only on factor weights but also upon 
relative independence from other factors. 

Factor 1 appears to reflect primarily relative satisfaction 
with the school and its operation. Factor 2 seems to be a measure of 
a person's relative sa^lsf action with teaching in general whereas 
Factor 3 is clearly a measure of one's liking for students. Factor 4 
is almost a mirror image of Factor 2, indicating degree of dislike of 
teaching or, perhaps more accurately, regret at being a teacher. Factor 
5 is also closely related to one's satisfaction with teaching, though 
it has more to do with one's perception of or satisfaction with the 
status of teachers. ' 

Analys e s of Communication and Attitude 

One of the main purposes of our study was to determine the extent 
to which our criteria for teaching effectiveness related to specific 
communication behaviors. To do this, we first rank ordered teachers 
according to each teaching effectiveness criterion, e.g., supervisor 
evaluation scores, etc., and then divided the rank ordered scores into 
high, moderate, and low evaluation groups and used an analysis of 
variance to test whether the groups differed significantly on the 
various measures of communication and attitude. A similar procedure 
was used to analyze the effects of class size on those measures that 
were most likely to vary with the number of students in a program. 
Finally, dividing teachers and students into racial groups allowed us 



53 



< 



CO 
Q 

H 
O 

a: 
o 



^4 

o 
o 



CO 
Q> 

4-» 



c 
o 

•H 

to 

•H 

CO 



in 



o 

CO 

a> 
x: 

O 

o 
c 

•H 

CO 

o 



DO 

3 



lO 

o 



o 



:3 
a> 



CO 

1 



CO 
CO 

x: 



o 
o 

X 

o 

O 



00 



o 



00 

o 



CM 

o 



LO 

o 



ro 
o 



JO 
o 



o 



o 



1^ 



00 



lO 
CM 



C7^ 
r- I 

I 



O 



to 
























CO 






























•H 






a> c 






35 


• 


o 












CO 






CO 














a> 




•H 


a> 




a> 






c ^ 


o 








O 














CO a> 






CO 




Q ^ 




c 




o 


cr 














TO >^ 


o c 










O 0) 


CO 


to 




CO n3 


O 


•H 
















•H 




CO ex. 




1—4 








O 


to c 


o 




O 


(0 


1-^ CD 


^ ;H 


o 






a> 


o 


a> ^ 






•H 


•H 


o . 














to 




O 




o o 


CO 






U 




<0 










& 


f-i 








CO 


to ;3 




o 








•H O 






• 


•» 


s 


^ & 


O 








8 






o 


O 


to 




C DO 








a> 




tn CO «-H 




to 


o 


to 


•H C 


a> o 








to 


•H 


^ to o 




> 




Cl^ 


<0 ^ 






O 






u u 




o 




o 


o 


o o 


a> 'H « 


•H 




o 




X » 


o > 








Q> 


O 1 


o ^ ^ 




o 


o 




CO 4-» 


^ a> H 




•r-i 


to 


CO 


a> to 


cx, to 


u 


CO 












6 


to 


cr 










•H 


cu 


a> ^ 


P CO 








X CO 




o 






H X 



00 



CM 

o 



o 



00 

I 



1 



o 

X 

o 

CO 

o 
bO 



O 
O 
X 
o 
to 

to 

•H 

X 



to • 

4^ to 

3 to 

CO 6 



o 



o 



(M 
I 



o 



O 



X 

H 3 

X o 
to 

cO iH 
to 

O ^ 

to o 
to § 

c p 

o ^ 



4-> 

c 

i-l 4J 

o to 
o 

X c 

U •H 

to 

to p 

•H CO 

X • 

CO ^ 

4J •H 

H-4 to «-t 



rH 
I 

CM 



O 



u 
o 

u 

4-> 
CO 

§ 

4^ 

o 
c: 

to 
o 
o 

bO 

•H c: 

O •H 

O X 
O CO 

to a> 

4^ 

U 

o o 
o 

^ bO 



T3 
CO 

X 



•H 

s> 

o 

o 



CM 

to 



ERIC 



•8 
g 

§ 

a 



H4 

iS 







































to 


• 

1 


• 




























U 
















0 










Q 






















o 




















W 




























H 




1 












Q> 
































4J 
















































o 




o 












to 


* 


* 






















































•H 






































O 










3 




i-H 
















o 






CN 








o 


















CM 


• 


* 




•rH 










1 






i\ 














n4 
Cq 
















Up' 










(/) 
















•H 
















JC 


































u> 




•H 




O 


• H 






•H •H 


w 












•H 


















t/) 


v 












O 




Cg 


W 






o 




•o 






•H 




•H 






•H 










4^ 
















U 










































(1) 






cn 






(1> C/) 










•H 






^ to 










tl 










Art 










H 
















o 
















•H •H 














































































& 
















0/ 


































«) 
































•H •H 
















U fH 














1 


•H 4-> 
















•-^ </) 
















O •H 
















Out? 
































H Q 














X O 


Co O 
















































cn tn 
































f— 4 












•H 


CM 
















• 


• 














1 














o 





























00 

o 



f-H 



CO 

o 



in 



o 



I 



M 
t 



00 
O 



00 


m 








o 


o 






o 


• 


• 

1 


• 




• 


CM 








f-H 


o 


o 


to 




o 


• 

1 


• 


• 




• 








4^ 








O DO 


<l> 


















i 


6 




O 










U) 






O 






o 








a> 




i s 


tft 


















u c 






o 


•H 




x: 


• 




DO 


0> ^ 




tft 








CO n:? 




g 












e «H 


4-» 








•H 












Cft 


g 


•M 




O 


4-» 








o «-« 


•H 


4^ 


0> 








(ft 




<D 


o P 


{/) 






(ft 


4J 








•H 


U 






i 




CD 






o 


o •o 




i 


















a> 


to 




•H 




o> . 


«H DO 


(h 


4-1 




> S 


^ p: 




•r 


•H O 




e Mh 




<-4 
















^ O (0 






oo o 








§ 




4-» 0> 


O •H4-» 


C 






4-> 


M Cft C 


O 




4S to 
















eft a> 






O O D 


•H 






o ^ 










H 4^ 









to 



in 



to 



in 
in 



ERIC 









f: 




•H 




jC 




U 








o 




H 


CM 


x: 








•H 




at 






O 






o 




•H 








O 
















•H 








t5 







o 



o to 

•H 

o 



O 



to 



in 
o 



I 



4^ 




(A 




0> 
























X 




B 












CO 




B 






X 


O 






a> 






o 


0 


s 


0 










o 


0 






,0 






c 




0 




•H 




4-> 


00 p 




















a> 


§ 




0 



O 
♦J 

o 

IX 



to 
o 

•H 
•H 



in 



to 
o 

x: 
o 

O rM 
C 

o 



0^ 

3 



o 



O 



to 

o 



fin 
o 

00 
3 c 

^ -H 

tn X 
*C (0 

(A 

4^ X 

U r-l 

ed X 
O X 

(4-1 U) 



00 

NO 



o 

I 



o 



CM 



<l> 
> 



o 
o 



P 
4J 
CO 

(D 



I 



CM 























III 0 












































0 (0 




0 q 




0 








0 ^1 




0 a> 




x Pi 












> 












0 X 




0 








•H 




0 




CO 4-> 












x: 0 




0 X 




4-» 




0) 0 


• 




(A 




a> Q 




X cd 


a 







ERIC 



i 

♦J 



< 





u 




o 








o 
















CO 










u 


C 


o 


•H 




















CO 
























0^ 



to 



U 

o 
u 

CO 

o 

c 
o 



•H 

CO 
O 



•H 

O 





to 




o 






1-H 












o 










to 




• 

1 


• 


• 


• 




• 

1 
1 




• 




sD 










o 












o 










lO 




• 


• 


• 


• 




• 




• 




1 




1 


1 


























o 






* >f 


\^ 


C4 
































1 




1 


















1^ 












o 














CNI 






* 


* 


* 




* 








1 


1 


1 






1 




1 




























s 


C *^ 














ft A 






















4^ 








u 
















•—1 








4-* 


V\> • 




















s 












O 


•H O 












O 
















O 


c 






"U 










VJ 


CO 






o c 




4^ 








oi 




w TO 


•JLJ 




























•H 






W VI 


a 






w 










t/l ♦J 


* % 
kJ 


























a> 


CO 






w ♦J 


/-\ 




k} 






Q> 


CD 


•H H 








f> 
M4 




i 






4-> 
















H 
















Q> 




•H O 






(A 


u 




O 


O 


<U 0) 




'r-l 




o 


0 






U 


O X 




o u 






x: 






eO 




CO t^. 


o <u 




U 


o 






u • 






x: X 






CO 






DO 


o ^ 




t> 4-> 




d> 














tn o 




Xt 


4-> 


CO 


:3 




4^ O 










0^ 




o 




o 








o 








C en 


o 


•H 6 






X 








3 


g 


x: o 






4^ 


CO 








s o 








t4^ 










o 




• 








>s 


U (/> 


P P 






O 




c: 




^ 0) 






CO 








o 


« (/) 


CO en 


^ P 




•H 




4-> 






d o 


E O • 


d> 


C/) CD 




4^ 


tn 


O 


*-> 


o o 


•H X a> 






•H 


O 


o 


u 


CO 




$-e 4-> 




<D O 




P 


B 




P- 


u 




2 


x: ,1: 










:3 






O en 


o ^ 


o 


x: 




o 




o a> o 




eO 






4-> 




o 


O 




o 


a> en 










o 


I-4 C 


A$ 4-» 




H CO 









to 



to 
to 



C7^ 
fsj 



to 



to 
o 



CM 
I 



lO 



x: 

4-> 

o 

4-> 

u 

CO 

p^ 



4-> 

o 



in 



o 

4-> 4J 
CO (A 

x: X 

4-* 



d> O 

a> o 
o 

i-H W 



CM 
CM 



ERIC 



1? 
o 



U3 

















03 




















o 


o 






c: 




o 
















O 




u 















o 

o 

CQ 

o 

c 
o 



00 

c: 

ctl 
o 



CM 
O 



O 



to 

Lrt 



00 

o 



o 



o 
o 



c 



^ ! 



o 



o 



to 



to 
t 



to 



o 



JO 









CO 












•H 






cn 


o 










rt 




0> 












en 


u 






t— « 




<u 


O 


CO 








U 


3: 






a> 


o 


P. 












St 






CO 


















1 


+-> 






cx 
















u 








r; 




o 






CC 












a> 


X 




o 


a> 






l-H 
f— < 




o 


cn 






03 






a> 








<u 


C3 






•H 




cc 


4^ 




(A 






en 


O 






o 


cn 




B 






c 










c« 




>. 




to 






a> 














X 




U 


* 


X 


03 




O 








o o 




o 


•H 










•H 




O • 


f% 

C« • 










.x: X 


<1> ctl 










CD C 




a. 




•H 


^< O 


1 § 


c 




O 


^ c 




3 w 






O 


w a 








o 




=^ i 


CD *f^. 


o 




o 


u 


O E 












x: o 


o 


^ c 




c 


8 


u 




H 3 


i- 





to 



ERIC 



to detemine whether, according to the coiuinunication measures, there 
was an interaction between the race of the teacher and the race of 
his students. 

Supervisor Evaluation Scores - Five items scaled from 1 (low) 
to 3 (high) comprised the Supervisor evaluation scoro (Appendix D) . 
The sum of the item scores was divided by the number of items checked 
to yield an overall score. ^ Thus, the highest possible score was 3.00 
and the lowest was 1.00. 

We had intended to divide the rank ordered scores into three groups 
1) the upper quartile; 2) the middle 50%; and 3) the lower quartile. 
However, 47 teachers received the maximum score; therefore, for the 
analyses made according to supervisor evaluation scores, a different 
method of grouping was employed. 

Since the supervisor evaluation measure consisted of five items 
scored from 1 to 3, each item score of 2 resulted in an overall drop of 
.2. That is, if four of the items received a score of 3 and one of the 
items received a 2, the average score was 2.8 or .2 less than 3. If all 
the items were scored one scale interval less than 3, the average score 
was 2, Thus, the difference between an overall score of 2 and 3 
represented an average of one scale interval difference per item. 

Using this rationale, we divided teachers into three groups: 

1) those that had a perfect supervisor evaluation score (n = 47); 

2) those that had a score below 3.00 but above 2.00 (n = 53); and 

3) those that had a score of 2.00 or less (n = 23). One teacher, who 
had no shop sessions on either day of observation, was dropped from 
the analyses; therefore, the total sample consisted of 125 teachers. 

In most cases, the backgrounds of the teachers in the three 
groups were quite similar (Table XIII). Those who received high 
supervisor ratings were slightly younger than teachers in the other 
groups but had slightly more practical experience. Interestingly, 
those teachers who received low ratings had an average of more years 
teaching experience than either the moderate or high evaluation groups. 

Table XIV shows further evidence of the similarities among the 
hree. groups. Teachers in the low evaluation group had a somewhat lower 
drop rate but a higher absentee rate than teachers in the other groups. 
Students of the low evaluation teachers were about a year younger than 
students of teachers in the other groups tut had completed relatively the 
same number of years of schooling and had been under the tmcher's 
instruction for approximately the same number of months. The average 
number of students in the classes of the three groups was also similar. 

In order to determine whether the three groups of teachers differed 
according to communication behaviors, a one-way analysis of variance was 
performed for each of the communication indices. ^ For all the analyses, 
the accepted level of significance was set at .05. 
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TABLE XIII 



BACKGROUND OF TEACHERS DIFFERENTIATED 
ACCORDING TO SUPERVISOR EVALUATION SCORES* 









Teach eTS 




with High 


with Moderate 


with tow 




Supervisor 


Supefvisor 


SupT\'i3or 




Ratings 


Ratings 


Ratings 




(n - 47) 


(n = 53) 


(n - 23) 


Years of practical experience 


21.4 


20.1 


21.0 


Years of education beyond the 








secondary level 


1.9 


1.7 


2.4 


Number of courses in vocational 








education 


6.2 


7.4 


12.0 


Number of courses in communication .9 


.8 


.8 


Number of courses in psychology 


1.4 


.9 


1.7 


Years of teaching experience 


6.7 


6.4 


10.5 


Years teaching current subject 








matter 


4.8 


6.0 


10.0 


Years at current school 


4.0 


4.2 


5.3 


Age 


45.9 


46.2 


49.5 



♦Average supervisor evaluation scores for teachers in the high evaluation 
group was 3.00; for teachers in the middle group, 2.50; and for teachers 
in the low group, 1.74. 
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TABLE XIV 



TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES— 

INFORMATION ON PROGRAM AND STUDENTS 





Teachers 


Teachers 


Teachers 




<.*4 4*1% 14A f*V% 

witn nign 


WxL>ll nUUCXcii'(7 






Supervisor 


Supervisor 


Supervisor 




Ratings 


Ratings 


Ratings 




Cn = 47j 




\Tl — J 


Percentage of students who 




14.5 


9.3 


dropped out of previous program* 




Percentage of students absent 


14.7 


15.1 


15.8 


Average age of students 


22.3 


22.1 


21.4 


Average number of months under 






7.0 


teacher* s instruction 


7.3 


7.6 


Average n^jmber of years of 








education 


11.0 


11.0 


10.7 


Average number of students in 








the class 


12.6 


12.5 


13.1 



♦Students who left a program to take a skills-related job were not 
counted as having dropped out. 



61 



The results showed significant differences for Dynamism 
(F = 5.77, p < .05). Delivery (F = 5.07, p <.Q5), Bodily Action 
(F = 5.77, p < .05), and Teacher Contact Time (F = 4.78, p < .025). 
Table XV shows that teachers in the high and moderate evaluation groups 
were judged as significantly more dynamic than teachers in the low 
evaluation group. ° (A lower mean score represented a higher rating.) 
Differences between teachers in the high evaluation group and those 
in the moderate group were not significant. 

An analysis of the means for Delivery revealed that teachers 
in the high evaluation group possessed significantly better delivery 
skills .indicated by lower scores) than teachers in the low evaluation 
group (fable XVI). Differences between teachers in the high and moderate 
evaluation groups and also between the moderate and low evaluation 
groups were not significant. 

Bodily action (gesture and eye contact) also revealed significant 
differences between teachers in the high and low evaluation groups 
(Table XVTI).'' Like the results on the Dynamism factor, significant 
differences were found between teachers in the moderate and low evaluation 
groups. In this analysis, as in the previous ones, the lower mean score 
indicates the more favorable rating. 

Analyses of variance were also performed for the shop communication 
measures that were first normalized before being combined into various 
indices of communication. The only significant difference was found for 
the index of Teacher Contact Time. Teachers in the low evaluation group 
spent significantly less time with students than teachers in either the 
moderate evaluation group or the high evaluation group (Table XVIII). 

Since these data have been normalized using the mean and standard 
deviation of the entire sample as a basis for transformation, the mean 
value for each item in the index is 0 and the standard deviation is 1. 
Thus, it can be seen that the high evaluation group spent considerably 
more than the average amount of time in direct contact with their students 
than did teachers in the other groups. Teachers in the moderate evaluation 
group spent slightly above the average amount of time with their students, 
while the negative value for teachers in the low evaluation group indicated 
that these teachers spent considerably less than the average amount of 
time in direct contact with their students. 

While the items that were normalized and then combined into various 
indices yielded more reliable data than might otherwise have been obtained, 
the transformations make it difficult to interpret the r..sults in terms 
of the average number of minutes per hour or the average number of contacts, 
etc. Therefore, a separate analysis was made for each behavior individually 
(Table XIX). These analyses, which included items that were not combined 
into indices, allow us to obtain a more useful understanding of the differences 
among the three groups in terms of various communication skills. As expected. 
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TABLE XV 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES- 
DYNAMISM* 





Teachers 
with Moderate 
Supervisor 
Ratings 


Teachers 
with Low 
Supervisor 
Ratings 
(X ^ 12.72) 


Teachers witn high supervisor 
evaluation ratings (X - 10.79) 


.14 


-1.93** 


Teachers with moderate supervisor 
evaluation ratings (X = 10.65) 




-2.07** 



* I terns comprising this factor are: 1) keeps everyone busy; 2) general 
vigor and enthusiasm; 3) skill at clarifying directions; 4) appearance 
of self-confidence; and 5) ability to create pleasant social-emotional 
environment. 

♦♦Significant 



TABLE XVI 

TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES- 
DELIVERY* 





Teachers 


Teachers 




with Moderate 


with Low 




Supervisor 


Supervisor 




Ratings 


Ratings 






(X = 10.87) 


Teachers with high supervisor 






evaluation ratings (X = 9.17) 


-.93 


-1.70** 


Teachers with moderate supervisor 




- .77 


evaluation ratings (X = 10.10) 





*Items comprising this factor are: 1) vocal loudness; 2) vocal rate; 

3) fluency; and 4) vocal variation. 
♦♦Significant 
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TABLE XVII 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES- 
BODILY ACTION 







Teachers 


Teachers 




with Moderate 


with Low 




Supervisor 


Supervisor 




Ratings 


Ratings 






(X = 3.09) 


Teachers with high supervisor 




-.55* 


evaluation ratings (X = 2.54) 


.03 


Teachers with moderate supervisor 






evaluation ratings (X = 2.51) 




-.58* 



*Signif icant 



TABLE XVIII 

TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES- 
TEACHER CONTACT TIME* 







Teachers 


Teachers 






with Moderate 


with Low 






Supervisor 


Supervisor 






Ratings 


Ratings 








(X = -.93) 




Teachers with high supervisor 








evaluation ratings (X = ^42) 




1.35** 




Teachers with moderate supervisor 








evaluation ratings (X = ^09) 




1.02** 



♦Items comprising this factor are: 1) the average number of minutes per 
hour teacher spent in contact with his students and 2) average number 
of minutes per hour adjusted for the number of students. 

♦♦Significant 
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the two items comprising the Teacher Contact Time index were both 
significant. In each case, teachers in the low evaluation group spent 
significantly less time in contact with students than did teachers in 
either the moderate or high evaluation groups. In addition, for teachers 
in the high evaluation group, the average length of time of the contacts 
was significantly greater than was the length of time of contacts for 
teachers in either the moderate or low evaluation groups. The average 
time of teacher-and student-initiated contacts also revealed significant 
differences, but these differences were mainly influenced by the measure 
of teacher contact time. 

One item, percentage of different students contacted, produced 
some unexpected results. Teachers in the high evaluation group contacted 
significantly fewer students than did teachers in the moderate or low 
evaluation groups. However, unless a class sire is greater than 28, the 
difference in the number of students contacted by the high evaluation 
group c^ompared to the others was less than one (3.5% of 28). In other 
words, the difference, while significant, is probably not meaningful 
since no class had that many students. 

Not all teachers conducted a formal classroom session separate 
from the shop session; however, for those teachers in each group who 
did, an assessment was made of their communication skills. Ten items 
comprised the classroom skills factor; however, some items were not 
always relevant to a given teaching situation. Therefore, a score 
was derived by summing the item scores and dividing by the number of 
items checked. 

Table XX shows that teachers in the high evaluation group were 
judged as significantly more skillful in handling the classroom session 
than teachers in the low evaluation group (F = 4.90; p < .025). 
No significant differences existed between teachers in the moderate 
evaluation group and those in either the high or low evaluation group. 

Responses to the Q-sort items vfere also analyzed to determine 
whether the three groups differed significantly in their attitude toward 
various aspects of teaching. To derive a raw score, we first selected 
those items from each of the five teacher attitude factors (Table XII) 
that had a high and distinct loading. For Factor l--Satisfaction? with 
school~-we chose the first five items. For the remaining factors, we 
chose only the first two items since in each case only two items were 
clearly associated with a single factor. The teacher's ranking of the 
items of each factor were then summed and used as an index of his 
attitude. Since several items had negative loadings, we had to reverse 
their polarity. This was done by subtracting the item score from 25. 
Thus, a 1 became 24 and a 24 became 1, etc. 

With the exception of the fourth factor (Regret at being a teacher), 
a lower score represents a more favorable attitude. Table XXI shows, 
however, that while the mean scores of teachers in the high evaluation 
group generally reflected a more favorable attitude than the mean scores 
of teachers in the low evaluation group, none of the differences were signifi- 
cant. 
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TABLE XX 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO SUPERVISOR EVALUATION SCORES- 
CLASSROOM SKILLS* 





Teachers 


Teachers 




with Moderate 


with Low 




Supervisor 


Supervisor 




Ratings 


Ratings 






(n = 10; 






X = 2.49) 


Teachers with high supervisor 






evaluation ratings (n - 23; 






X = 1.93) 


-•27 


-.56** 


Teachers with moderate super- 






visor evaluation ratings 




-.29 


vn = 23; X ^ 2.20) 







*Items comprising this factor are: 1) organization of information; 
2) use of examples and illustrations to claiify information; 3) 
skill at using visual aids; 4) ability to create pleasant social- 
emotional environment; 5) enthusiasm for matter being taught; 6) 
appearance of self-confidence; 7) discipline; 8) skill at generating 
discussion and questions; 9) skill at showing relevance; and 
10) management of problem- solving session. 
**Signif icant 
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The prectiding analyses reflect the differences in coramunication 
abilities air?^- teachers who were grouped according to supervisors' 
perception o.^ their abilities. Most of the differences existed 
between the high or moderate and low evaluation grcups. Highly rated 
teachers :md those with moderate evaluations were significantly more 
dynami * :han those teachers who were rated low and the high evaluation 
group iiad significantly better delivery skills. The use of gesture 
and eye contact (bodily action) by the high and moderate groups was 
a! o judged as superior. In addition, the highly rated teachers and 
those with moderate ratings spent significantly more time in direct 
contact with their students than teachers who were rated low. The 
teachers with high evaluations also conducted their classroom sessions 
significantly more skillfully than teachers in the low group. 
Surprisingly, the high evaluation group contacted a significantly 
smaller percentage of students than did the moderate and low evaluation 
groups. An inspection of the means indicated, however, that the 
differences between the high evaluation group and the other two may not 
have been important. 

Student Evaluation Scores , Following the analyses based upon 
supervisor evaluations, the teachers were regrouped according to their 
student evaluation scores. These data were derived by summing for each 
teacher the mean scores of the nine items on the student evaluation 
form. (The mean score of an item was the sum of the student evaluation 
scores for that item divided by the number of students in the class.) 
The scores were then rank ordered ancf teachers were divided into three 
groups: 1) the upper quartile fn - 30); 2) the middle 50% (n = 63); 
and 3) the loi^rer quartile (n = 30). 

Table XXII shows the background of the three groups of teachers. 
As was the case for the supervisor evaluation groups, the same teachers 
grouped according to student ratings varied only slightly. ^ The teachers 
with high student evaluations were somewhat younger than teachers in the 
moderate and low evaluation groups and had less teaching and practical 
experience. 

Drop rate was lowest for teachers in the high evaluation group, 
but absentee rate was lowest for teachers in the low evaluation group 
(Table XXIII), The age of the students in each group as well as the 
number of students in the class, the number of months they had been 
under the supervisor's instruction, and their achieved educational level 
were also quite similar. 

While the background information about the teachers and the 
students was very similar, the analyses of variance of communication 
indices revealed inany significant differences that existed among the 
three groups of teachers. Table XXIV shows that teachers in either 
the high evaluation or moderate evaluation group were judged significantly 
better on the Dynamism factor than were teachers in the low evaluation 
group (F = 5.90; p < .005). The difference between the mean scores of 
teachers in the high evaluation group and those in the moderate evaluation 
group was not significant. 
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TALLE XXII 



BACKGROUND OF TUACHERS DIFFERENTIATED ACCORDING TO 
STUDENT EVALUATION SCORES* 



• 


Teachers 


Teachers 


Teachers 




with High 


with Moderate 


with Low 




Student 


Student 


Student 




Ratings 


Ratings 


Ratings 




(n = 30) 


(n = 63) 


(n = 30) 


(Mean Values) 


Years of practical experience 


19.0 


21.5 


21.0 


Years of education beyond 




1.8 




secondary level 


2.0 


2.1 


Number of courses in 








YOcatioHv-l education 


7.1 


8.4 


7.2 


Number of courses in communica- 






.8 


tion 


J 


1.0 


Number of courses in psychology 


1.0 


1.2 


1.5 


Years of teaching experience 


6.3 


7.6 


7.7 


Years teaching currert subject 






6.8 


matter 


5.2 


6.6 


Years at current school 


3.8 


4.5 


4.5 


Age 


45.1 


47.9 


45.8 



*The average student evaluaton score for teachers in the high evaluation 
group was 49.47; for teachers in the moderate evaluation group, 46.11; 
and for teachers in the low eva' aation group, 39.05. Each of the nine 
items was scored from 1 (low) to 6 (high) . 
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TABLE XXIII 



TEACHERS DIFFERENTIATED ACCORDING TO STUDENT EVALUATION SCORES-- 
INFORMATION ON PROGRAM AND STUDENTS 





Teachers 


Teachers 


Teachers 




with High 


with Moderate 


with Low 




Student 


otudent 






Ratings 


Ratings 


Ratings 




(n = 30) 


(n = 63) 


(n = 30) 


Percentage of students who 








dropped out of pievious 








nroerani* 


10.4 


15.2 


11.6 


Percentage of students 








absent 


14.9 


15.6 


14.2 


Average age of students 


ft c 


21.5 


22.7 


Average number of months 






8.0 


under teacher's instruction 


6.6 


7.4 


Average number of years of 








education 


U.O 


10.9 


10.9 


Average number of students in 








the class 


12.4 


12.5 


16.1 



*Students who left a program to take a skills-related job were not 
counted as having dropped out. 
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TABLE XXIV 



TABLH OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO STUDENT EVALUATION SCORES-- 

DYNAMISM* 



Teachers 
with Moderate 
Student 
Ratings 



Teachers 

with Low 

Student 

Ratings 

(X = 12.77) 



Teachers with high student 

evaluation ratings (X ^ 10.30) -.37 -2.47** 

Teachers with moderate student 

evaluation ratings (X « 10.67) -2.10** 



* Items comprising this factor are: 1) keeps everyone busy; 2) general 
vigor and enthusiasm; 3) skill at clarifying directions; 4) appearance 
of self-confidence; and 5) ability to create pleasant social -emotional 
environment. 

**Signif icant 
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The Teacher Contact Time index also indicated significant 
differences among the three groups (F = 3.85 p < .025). The normalized 
data in Table XXV indicate that teachers in the high evaluation group 
and those in the low evaluation group spent significantly more time in 
direct contact with their students than did teachers in the moderate 
evaluation group. The difference between the average amount of contact 
time for teachers in the high evaluation group and those in the low 
evaluation group was negligible. 

The analysis of variance for the Positive Reinforcement index 
(Table XXVI) showed that teachers in the high evaluation group scored 
significantly higher on this index than did teachers in either the 
moderate evaluation or the low evaluation group (F = 4.09; p < .025). 

Since the data v^ere normalized, the mean scores for each group 
reflect the magnitude of the deviation from the overall mean (0). While 
the average score for teachers in the high evaluation group was more than 
one standard deviation unit beyond the mean, the average scores for 
teachers in the moderate and low evaluation groups fell below the mean. 

Table XXVII presents a breakdown of each communication item 
analyzed separately and explains, perhaps, the reason that the moderate 
group differed significantly from the low evaluation group in the amount 
of time spent in direct contact with their students. For instance, in 
Table XXV it was reported that teachers in the low evaluation group 
spent significantly more time in their initiated contacts with students 
than teachers in the moderate evaluation group. This finding is 
supported in Table XXVII which shows that "Number of minutes per 
student per hour of teacher -initiated contacts with students" was the 
nost important item of the index contributing to that significance. 
However, when average time of student -initiated contacts was considered 
(i.e., the item "Average number of minutes per hour that students 
spent in their initiated contacts with teacher"), just the opposite 
significant difference was found. Students of teachers in the moderate 
evaluation group averaged significantly vove time per student than 
students of teachers in the low evaluation group. Thus, the two 
significant differences counterbalanced one another. This effect is 
shown more clearly in Table XXVI!, in the combined teacher and student 
contact time measures (Number of irjnutes per hour spent in teacher- 
initiated student- initiated conuacts and Number of minutes per 
student per hour spent in teacher-initiated + student-initiated contacts). 
An analysis of these items indicated that no signifi^cant diffc.ences 
existed among the three groups of teachers. In fa^t, v/hile Table XXV 
revealed that teachers in the high evaluation group spent signi^^icantly 
more time in contact with their students than teachers in the moderate 
evaluation group, the combined teacher and student contact time items 
showed no significant differences. 

''•^e significance of the Positive Reinforcement index was influenced 
primarily by the mcasixo of banter. Teachers in the high evaluation group 
engaged in banter significantly more often than did teachers in either 
the moderate or low evaluation groups. While the number of instances of 
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TABLI- XXV 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFHRENTIATnO ACCORDING TO STUDENT EVALUATION SCORES— 

lEACHER CONTACT TIME* 





Teachers 


Teachers 




WXL.ll rlLIUv*AilLw 


W ^ Cli LiKJjn 




Student 


Student 




Ratings 


Ratings 






(X = .45) 


Teachers with high student 






evaluation ratings (X = .49) 


.89** 


.04 


Teachers with moderate student 






evaluation ratings (X = -.40) 




.85** 



♦Items comprising this factor are: D the average number of minutes per 
hour teacher spent in contact with his students; and 2) average number 
of minutes per hour adjusted for the number of students. 

**Signif icant 



TABLE XXVI \ 

TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO STUDENT EVALUATION SCORES- 
POSITIVE REINFORCEMENT 





Teachers 


Teachers 




with Moderate 


with Low 




Student 


Student 


1 


Ratings 


Ratings 






(X = -.63) 


Teachers with high student 






evaluation ratings fX = 1.12) 


1.32** 


1 .75** 


Teachers with moderate student 






evaluation ratings (x* - -.20) 




.43 



*Items comprising this factor arc: 1) the number of instances of positive 
reinforcement per hour; 21 the positive/negative reinforcement ratio ; and 
3) the number of instances of banter per hour. 

♦♦Significant 
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positive reinforcement per hour and the positive/negative reinforcement ratio 
showed nc significant differences, teachers in the high evaluation 
group scor-^d approximately twice as high on these indices as did 
teachers in the low evaluation group. Scores of teachers in the moderate 
evaluation group fell between the other two. 

An analysis of variance of the classroom data (Table XXVIII) 
showed that teachers in either the high evaluation group or those in 
the moderate evaluation group were judged as significantly more skillful 
in conducting a formal classroom session than teachers in the low evalua- 
tion group (F = 10.61; p < .001). No significant difference was 
found for either the noise level in the classroom or the amount of time 
the teacher kept an obstacle between himself and his students. 

An analysis of variance of the data obtained from the Q-sort 
rankings showed that teachers in the high and moderate evaluation groups 
had significantly more favorable attitudes toward their students than 
did teachers in the low evaluation group (Table XXIX). Also, teachers 
in the moderate evaluation group were significantly more satisfied with 
the status of their work than were teachers in the low evaluation group. 
Although the mean differences for the other factors were not significant, 
all of them were in the expected direction. (For the fourth factor, 
higher scores represent a more favorable attitude.) 

To summarize the results of the analyses made according to student 
evaluation scores, we found that information about the background of 
teachers in each group, their programs, and their students, was very 
similar. However, significant differences were found in various communi- 
cation skills and in the attitudes of the teachers. Teachers who fell 
in the high and moderate evaluation groups were significantly more 
dynamic than teachers in the low evaluation group. Also, they were 
judged as having significantly better classroom communication skills 
than the low evaluation group and had significantly more favorable 
attitudes toward their students. In addition, while the high evalua- 
tion group scored significantly higher on the Positive Reinforcement 
index than either the moderate or low evaluation groups, the moderate 
evaluation group indicated a significantly more positive attitude toward 
their role as teachers than did the teachers of the low evaluation group. 

Combined Supervisor and Student Ratings . IVhile the analyses of 
teachers grouped according to supervisor ratings and then* according to 
student ratings shed some light on the relationship betweon the two teaching 
effectiveness criteria and the behavior and attitude of Industrial 
Education teachers, they did not reveal how the two rating measures 
interacted. For example, teachers in the high supervisor evaluation 
group were not necessarily in the high student evaluation group, and 
vice-versa. In fact, some teachers were in the high evaluation group 
according to one rating but in the low evaluation group according to 
another. Such differences in evaluations may have also been reflected 
in differences in the teacher* s behavior and attitude. Therefore, a 
combined grouping was performed to test how differences in evaluations 
might be explained by communication behavior and attitude. 
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TABLE XXVIII 

TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO STUDENT EVALUATION SCORES- 
CLASSROOM SKILLS* 







Teachers 


Teachers 




with Moderate 


with Low 




Student 


Student 




Ratings 


Ratings 






(n = 14; 






X = 2.60) 


Teachers with high student 
evaluation ratings (n = 14; 
X = 1.89) 

Teachers with moderate student 
evaluation ratings (n = 28; 
X = 2.02) 


-.13 


-.71** 
-.58** 



♦Items comprising this factor are: 1) organization of information; 
2) use of examples and illustrations to clarify information; 3) skill 
at using visual aids; 4) ability to create pleasant social -emotional 
environment; 5) enthusiasm for matter being taught; 6) appearance of 
self-confidence; 7) discipline; 8) skill at geneiating discussion 
and questions; 9) skill at showing relevance; and 10) management of 
problem-solving session. 
**Significant 
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With three groups formed from each evaluation criterion, the 
combincJ ratings made it possible for a teacher to be placed in one of 
nine groups, a high supervisor-high student rating group, a high 
supervise* -moderate student rating group, etc. Since cell sizes would 
be decreased considerably by the increased number of groups, the high 
supervisor and moderate student rating group was combined with the 
moderate supervisor and high student rating group. Likewise the moderate 
supervisor and low student rating group was combined with the low 
supervisor and moderate student rating group. This procedure eliminated 
two groups. The remaining seven groups were comprised of teachers with: 
1) high supervisor and high student evaluations (n = 14); 2) high 
supervisor and moderate student evaluations or moderate supervisor and 
high studeut evaluations (n = 54); 3) high supervisor and low student 
evaluations (.n = 10); 4) moderate supervisor and moderate student 
evaluations (n = 32); 5) low supervisor and high student evaluations 
(n = 5); 6) moderate supervisor and low student evaluations or low 
supervisor and moderate student evaluations (n = 20); and 7) low 
supervisor and low student evaluations (n =8). 

Table XXX shows a comparison of the background of the teachers 
in each group. Few teachers received high supervisor and low student 
ratings (n = 10) or low supervisor and high student ratings (n =5), 
and while 50 teachers comprised the upper quartile of student ratings, 
less than half of them had a similarly high supervisor rating. There 
were only half as many teachers in the low supervisor- low student 
evaluation group as in the high one. The reason for this was that only 
25 teachers comprised the low evaluation group according to supervisor 
ratings. Of those 25 teachers, on]y eight fell into the lower quartile 
of student evaluation scores. 

Despite the large number of groups created by the various combina- 
tions of supervisor and student evaluation scores, the only apparent 
systematic difference was found between the teachers of the two extreme 
groups, i.e., those teachers who were rated high by supervisors and 
students and thc^e who were rated 'ow by them. The teachers in the high 
evaluation gro'ip were on the average approximately seven and a half years 
younger than teachers in the lower evaluation group. Probably as a 
consequence of that, teachers in the high evaluation group reported 
fewer years of practical and teaching experience than did teachers in the 
low evaluation group. Also, they had acquired less formal education than 
low evaluation teachers. 

For the two groups (5 and 5) comprised of teachers with markedly 
variant ratings, the figures show that teachers with high supervisor and 
low student evaluation scores were younger than those with low supervisor 
' and high student evaluation scores but had more years of practical 
experience. These findings coincide with the relationships between 
each evaluation criterion and age and practical experience. For instance, 
the correlation between supervisor ratings and the age of the teachers 
is negative, (-.11), whereas the correlation between supervisor ratings 
and practical experience is slightly positive (.06). Just the opposite 
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relationship is found for the student evaluation scores. While the correla- 
tion is slightly positive for teacher age, (•04) it is slightly negative 
for practical experience (-.03). 

Table XXXI indicates that the students of teachers who received 
high supervisor and high student ratings were somewhat older than the 
students of teachers in the other groups. However, little can be 
inferred from this finding since the next oldest group of students is 
found for teachers who received just the opposite rating, ^toreover, 
the relationship between the average age of the students aiaU the supervisor 
and student evaluation scores was negligible, .02 for the former rr.ting 
and -.01 for the latter. 

As might have been expected, analyses of variance of the shop 
coifii;rj/ticat ion indices followed a pattern similar in most respects to 
tbn of the supervisor and student evaluation groups analyzed separately, 
hovevvr, a clearer indication is given of the differences in the criteria 
usecl supervisors and students in assessing a teacher's abilities. 

Yahle XVKTI shows that teachers with low supervisor and low student 
vvalniition scores were nulged as significantly less dynamic than teachers 
in all but the third and fifth groups (F = 3.02; p < .005). These 
latter groups were coinpriiscd of teachers whose supervisor and student 
ratings were opposite. Interestingly, their mean ratings were the 
lowest of all groups except the last one (the group with low supervisor 
and low student evaluation scores). 

In addition to the significant differences between group seven 
and the other groups, a significant difference was also found between 
the first group and the third. Teachers who received high supervisor 
and high stuJent ratings (group one) were judged as significantly 
more dynamic than teachers who received high ratings from their super- 
visor but low ratings from their students (group three). 

Table XXXIII shows that teachers in the first two groups, i.e., 
those with superior or moderately favorable supervisor and student ratings, 
spent significantly less time behind an obstacle than did teachers in 
the fifth group (F = 2.49; p < .05). IVhile the difference between means 
of the first or second group and that of the last group was quite large, 
it was not significant. Since the fifth group is comprised of teachers 
with low supervisor and high student evaluation scores, these findings 
indicate that supervisors were more aware of or gave greater weight to 
how a teacher used time and space. This notion is more clearly supported 
by the results of the analyses made according to the supervisor evaluation 
scores. As previously noted, significant differences were found for the 
Teacher Contact Time index. However, when student evaluation scores 
were used as the criterion for grouping teachers, no significant difference 
resulted on this measure. 
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Another sigr.ificant difference was found for the index of Positive 
Reinforcement (F = 2.28; p < .05). The normalized data in Table XXXIV 
show that significant differences existed between the first groiip and 
all the others except groups two and five. The lack of significance 
for the fifth group, however, is probably due to the smll number 
of teachers (5) in that group since the mean rating (-.87) is lower than 
the mean rating of any of the other groups except group seven. 

The analyses of variance of Delivery and Bodily Action* which 
showed significant differences among the three groups of teachers when 
supervisor evaluation scores were used as the independent criterion, 
were not significant for the combined evaluation criteria. In both 
cases, however, teachers in the third group (high supervisor and low 
student ratings) scored higher than teachers in the fifth group (low 
supervisor and high student ratings). 

Table XXXV gives the mean differences for Banter, the only 
communication measure that showed significant differences when each 
communication item was analyzed separately. While the differences in 
mean values for the other communication indices were almost always 
in the expected direction, a comparison of the between and within 
variance terms for the combined and separate analyses indicated that 
for the combined analyses the between groups variance was reduced 
considerably while the within groups variance was slightly increased. 
This alteration in between variance resulted from the fact that 
increasing the number of groups also increased the nun^er of degrees 
' of freedom, the denominator used in determining the mean square between 
groups. Conversely, the reduction in cell sizes reduced the numerator 
used in calculating that term. As a consequence, the power of the test 
to detect a significant difference was lessened considerably. 

The available classroom data were also analyzed (Table XXVI), 
and the results showed that teachers with high supervisor and high 
student evaluation scores were judged as significantly more skillful 
in handling their classroom session that teachers who had received low 
supervisor and low student evaluation scores (F « 4.20; p <' .005). 
Teachers in the second group (high supervisor and moderate student 
evaluation scores or moderate supervisor and high student evaluation 
scores) were also judged as significantly more skillful in classroom 
management than teachers in the last group (low supervisor and low 
student evaluation scores). Although the mean values of the first and 
second groups were almost identical, the cell size of the second was 
such that significance was a^so obtained between the scores of teachers 
in that group and teachers -n the fourth group (moderate supervisor 
and moderate student evaluation scores) . 

The remaining analyses based on the combined supervisor and 
student evaluation scores were made for each of the five teacher 
attitude dimensions. The results of these analyses, shown in Table 
XXXVII, indicate that highly rated teachers had significantly more 
favorable attitudes toward students than teachers with low ratings. 
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Absentee Rate . Following the analyses of the combined supervisor 
and student evaluation scores, teachers were regrouped according: to 
absentee rate. Those in the lower quartile (i.e., teachers with the 
lowest absentee rate) had an average absentee rate of less than one per 
cent. Teachers in the middle 50 per cent of the sample had an absentee 
rate of 12 per cent, while teachers in the upper quartile had an average 
of 37 per cent of their students absent. 

No significant differences beyond what might have been expected 
by chance were found for any of the indices of communication. (As 
will be noted in the regression analyses, the only factors that varied 
significantly with absentee rate were the average age of the students 
and noise level, very likely an age-related factor.) Students of teachers 
in tho low absentee rate group were, on the average, 25 years old, while 
students of teachers in the middle 50 per cent group averaged 21 years 
of age. The high absentee rate students averaged just over 18 years of 
age. 

Drop Rate . Teachers grouped according to drop rate also failed 
to reflect any differences in communication skills. The lower quartile 
of teachers reported a rero drop rate whereas the middle 50 per cent and 
upper quartile of teachers had an average drop rate of 9 per cent and 
36 per cent respectively. 

While students of teachers in the three drop rate groups were 
approximately the same age, the teachers were not. Those in the high 
drop rate group were on the average five years older than teachers in the 
low drop rate group and seven years older than teachers in the middle 
group. (This finding coincides with the regression analysis, the results 
of which are reported in the next section. This analysis indicated that 
the best predictor of drop rate according to the factors from which a 
prediction had to be made was the teacher's age.) 

To summarise, the results of the analyses made according to 
absentee rate and drop rate suggest that these factors are not explain- 
able in terms of the communication abilities of the teachers. Instead, 
they appear to be a result of the age of students in the program and, 
perhaps, the age of tho teacher. 

Class Size . Besides the four teaching effectiveness criteria, 
another variable which we believed might be associated with different 
communication behaviors was the number of students in a class, since the 
indices which were adjusted for the number of students varied with class 
size. In order to test whether class size variations made a difference, 
we divided teachers into four groups, those having: 1) less than 10 
students in their class (n = 32); 2) 11-14 students (n = 50); 3) 15-18 
students (n = 33); and 4) 19 or more students (n = 8) . An analysis of 
variance was then performed for each communication item that would most 
likely be related to class size. 
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As expected, most of the significant differences in behavior were 
founa for those indices which were adjusted for the number of students 
in the class. Table XXXVI 11 shows that the time of teacher- initiated 
contacts per student was significantly greater for teachers with less 
than 10 students than for teachers in any of the other groups (F « 
9.04; p < .001). Table XXXIX shows a somewhat different pattern for 
the average time of student- initiated contacts (i.e., the time per 
student per hour) . 

iVhereas the average time was smallest for teachers in the largest 
class size group, the average time was greatest for teachers who had 
between 15 and 18 students. Differences in average time between this 
group and each of the other three were significant (F « 3.10; p < .05). 
In addition, the difference between the average time of the first two 
groups was also significant. 

Tabl3 XL, which considers the combined time of teacher- and 
student-initialed contacts (adjusted for the number of students), reveals 
a pattern similar to that found in Table XXXVIII. The average rontact 
time per student of teachers in the first group was significantly^ 
greater than the average time of teachers in any of the other groups 
(F = 17.64; p < .001). 

Tables XLI and XLII show that despite the longer duration of 
contacts per student of teachers in the smaller class size groups, 
teachers and students in the larger classes made significantly more 
contacts per hour (Table XLI : F = 3.15; p < .05; Table XLII: 
F = 5.81; p < .001). 

When the data for teacher- and student-initiated contacts were 
combined, as shown in Table XLI II, a similar pattern was found. Teachers 
and students in two of the three larger class size groups made significantly 
more contacts per hour than teachers with classes of less than ten students 
(F - 5.35; p < .005). While the difference between the smallest and 
largest class size groups was not significant (due to the small number of 
teachers having 19 or more students), it was in the expected direction. 

Table XLIV shows a different pattern when the data are adjusted 
for the number of students in a class. Teachers and students of classes 
with less than 10 students made significantly more contacts per student 
than teachers and students in classes whose sizes were either between 
11 and 14 students or 19 or more students. 

The results of the analyses made according to class size showed 
that most of the significant differences occurred between the smallest 
class size group (10 students or less) and each of the others. In only 
two instances did significant differences exist between groups having 
a class size of more than 10 students (Table XXXIX). Also, only one 
significant difference between the first group and one of the others 
was opposite the expected direction. As shown in Tabic XXXIX, students 
of teachers having between 15 and 18 students averaged significantly 
more time per contact than students of teachers having less than 10 students. 
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TABLE XXXVIII 



TABLE OF DIFFERENCES FOR ^ 
TEACHERS DIFFERENTIATED ACCORDING TO CLASS SIZE- 
TIME OF TEACHER- INITIATED CONTACTS PER STUDENT 



Teachers 
with classes 
of 11-14 
students 


Teachers 
vith classes 
of 15-18 
students 


Teachers 
with classes 
of 19 or inore 
students 
(3f « 1.21) 


Teachers with classes 

of less than 10 students 

(X= 3.03) 1.46* 


,88* 


1.78* 


Teachers with classes 
of between 11-14 
students 
(X « 1.S7) 


-.58 


.36 


Teachers with classes 
of between 15-18 
students 
(X = 2.15) 




.94 



♦Significant 
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TABLE XXXIX 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO CLAiiS SIZE- 
AVERAGE TIME OF STUDENT- INITIATED CONTACTS 





Teachers 
with classes 
of 11-14 


Teachers 
with classes 
of 15-18 


Teachers 
with classes 
of 19 or 
more students 
(X = .19) 


Teachers with 
classes of 
less than 10 
students 
(X = .581 


.30* 


-.38* 


.39 


Teachers with 
classes of between 
11-14 students 
(X = .28) 




-.68* 


.09 


Teachers with 
classes of between 
15-18 students 
(X = .96) 






.77* 



*Significant 
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TABLE XL 



I'ABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO CLASS SIZE- 
AVERAGE TIME OF TEACHER- AND STUDENT- INITIATED CONTACTS 





Teachers 
with classes 
of 11-14 
students 


Teachers 
with classes 
of 15-18 
students 


Teachers 
with classes 
of 19 or more 
students 
(X = 1.38) 


Teachers with classes 
of less than 10 
students 
(X « 3.51) 


1.71* 


1.23* 


2.13* 


Teachers with classes 
of between 11-14 
students 
(X = 1.80) 




-.48 


.42 


Teachers with classes 
of between 15-18 
students 
(X= 2.28) 






.90 



♦Significant 



100 



TABLE XLI 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO CLASS SIZE- 
NUMBER OF TEACHER-INITIATED CONTACTS 





Teachers 
with classes 
of 11-14 
students 


Teachers 
with classes 
of 15-18 
students 


Teachers 
with classes 
of IS or more 
students 
(X = 26.30) 


Teachers with classes 
of less than 10 
students 
(X= 21.16) 


-7.89* 


-5.14 


-5.14 


Teachers with classes 
of between 11-14 
students 
(X = 29.05) 




2.75 


2.75 


Teachers with classes 
of between 15-18 
students 
(X = 26.30) 









♦Significant 
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TABLE XLII 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO CLASS SIZE 
NUMBER OF STUDENT- INITIATED CONTACTS 





Teachers 
with classes 
of 11-14 
students 


Teachers 
with classes 
of 15-18 
students 


Teachers 
with classes 
of 19 or more 
students 
(X « 15.53) 


Teachers with classes 
of less than 10 
students 
(X » 8.87) 


-6.26* 


-5.09* 


-6.66 


Teachers with classes 
of between 11-14 
students 
(X 15.13) 




1.17 


- .40 


Teachers with classes 
of between 15-18 
students 
(X « 13.96) 






-1.57 



♦Significant 
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TABLE XLIII 



TABLE OF DIFFERENCES FOR 
TEADffiRS DIFFERENTIATED ACCORDING TO CLASS SIZE- 
NUMBER OF TEACHER- AND STUDENT-INITIATED CONTACTS 





m \* ft x<* A ^ 

with classes 
of 11-14 
students 


Teachers 
with classes 
of 15-18 
students 


Teachers 
with classes 
of 19 or 
more students 
(X » 42.29) 


Teachers with classes 
of less than 10 
students 
(X = 30.69) 


-13.46* 


-10.10* 


-12.60 


Teachers with classes 
of between 11-14 
students 
(X = 44.15) 




3.36 


.86 


Teachers with classes 
of between 15-18 
students 
(X = 40.79) 






- 2.50 



♦Significant 
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TABLE XLIV 



TABLE OF DIFFERENCES FOR 
TEACHERS DIFFERENTIATED ACCORDING TO CLASS SIZE- 
AVERAGE NUMBER OF TEACHER- AND STUDENT- INITIATED CONTACTS 





Teachers 
with classes 
of 11-14 
students 


Teachers 
with classes 
of 15-18 
students 


Teachers 
with classes 
of 19 or more 
sxuoGnvs 
(X « 2.19) 


Teachers with classes 
of less than 10 
students 
(X = 3.92) 


1.14* 


.52 


1.73* 


Teachers with classes 
of between 11-14 
students 
(X « 2.78) 




-.62 


.59 


Teachers with classes 
of between 15-18 
students 
(X = 3.40) 






1.21 



♦Significant 
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Racial Differences . To determine whether teachers and students 
interacted differently with members of a different race than with members 
of the same race, we selected for study those classes that had a student 
racial proportion of at least one to four. In other words, 25 to 50 
per cent of the students would be of one race, and 50 to 75 per cent of 
the students would be of the other. The classes of only four of the nine 
black instructors met this criterion, while the classes of 26 white 
instructors had the necessary proportion. 

For each black and white instructor, the shop communication 
indices were reconstructed. The data used in computing each index 
were based first on the teacher's interaction with white students and 
then on his interaction with black students. Thus, a teacher had two 
scores for each index. 

Differences in communication behavior could result from differences 
in proportionality. For example, if three-fourth of the students in a 
class were white, it would not be surprising to find that a teacher 
initiated contacts with white students three times as often as with 
black students. However, the communication indices that were adjusted 
for the number of students in a class compensated for differences in 
proportionality. Therefore, we decided to use as dependent measures the 
four indices that would accurately reflect teacher and student inter- 
action according to race. These indices were: 1) the number of teacher- 
initiated contacts per student per hour; 2) the number of minutes per 
student per hour of teacher- initiated contacts with students; 3) the 
average number of student -initiated contacts per hour--i.e., the number 
of contacts averaged according to the number of students; and 4) the 
average number of minutes per hour that students spent in their 
initiated contacts with the teacher. 

For each index a 2 X 2 factorial design (Figure 2) was used to 
test racial differences in communication. 

White Black 
Students Students 



White Teachers 

(n = 26) 

Black Teachers 

Cn = 4) 

Figure 2. Factorial Design for Testing Racial 
Differences in Communication 

The results of the analyses showed, however, no significant interactions 
between the teacher's race and the race of the students. Main effects 
were also non-significant. 
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Since the small number of black instructors probably precluded 
a meaningful test for significant differences, a series of graphs were 
prepared to enable an additional inspection of possible interactions. 
Figures 3 through 6 depict the mean values for each index. White 
teachers interacted more frequently and for a longer duration with white 
students than they did with black students. Likewise, black teachers 
made more contacts with their black students than they did with the white 
ones; however, the black teachers spent approximately the same amount of 
time with students, regardless of race, though they spent somewhat less 
time with either group than white teachers did. 

In contrast to the white teachers, white students contacted their 
black teachers more frequently than they did white teachers but spent 
the same amount of time with each. The black students, however, exhibited 
a pattern of behavior similar to the white teachers. They made more 
contacts with the black teachers than they did with white teachers and 
also spent more time in contact with the black teachers. 
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Figure 3. -- Teachers and Students Differentiated According to Race — 
Number of Teacher- Initiated Contacts per Student per Hour 
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Number of minutes 
per student per 
hour 


White 
Students 


Black 
Students 


1.2 


(X = 1.191 




1.1 






1.0 






.9 




'(X = .88) 


• .8 
.7 


(X = .85L__ 


(X*= .80) 


White Teachers 






Black Teachers 







T 



Figure 4. Teachers and Students Differentiated According to Race 
Number of Minutes per Student per Hour of Teacher-Initiated Contacts 
with Students 
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White 
Teachers 


Black 
Teachers 


1.8 




(X « 1.80) 


1.7 






1.6 






1.5 






1.4 
1.3 


(1 « 1.37) 




1.2 
1.1 
1.0 
.9 


(X « .90) 


/(X » 1.28) 


White Students 
Black Students 







Figure 5. — Teachers and Students Differentiated According to Race- 
Average Number of Student- Initiated Contacts per Hour 
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White Black 
Teachers Teachers 



.95 ^ (X = .95) 

.90 ' 
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.80 

.75 
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White Students 
Black Students 



Figure 6. — Teachers and Students Differentiated According to Race- 
Average number of minutes per hour that students spent in their 

initiated contacts with teacher 
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Correlational Analyses 



Two sets of correlational analyses were carried out with the data 
collected in this study. In the first set of analyses, all independent 
variables were correlated with all four of the measures of teacher 
performance- -supervisor evaluations, student ratings, drop rate, and 
absentee rate and then multiple correlations were computed in order to 
see what combination of independent variables would best predict the 
quality of teacher performance. Because we were primarily interested 
in getting ideas for ways in which teachers could improve the quality 
of their teaching, we did a second set of multiple correlations, this 
time using only the independent variables that a teacher might be able 
to do something about— i.e., variables that were aspects of a teacher's 
performance in the classroom. We omitted those variables over which a 
teacher had no control, e.g., his age or the number of years he had 
been a teacher, etc. 

In planning and carrying out these analyses, we recognized that 
teaching is a complex activity and that even with all of the variables 
that were included in this study, there were still probably many other 
important and subtle variables that affect teaching performance that we 
did not consider. In addition, the heterogeneity of programs and levels 
of instruction that were included in this study increased with the wi thin- 
groups variance, which has the effect of further reducing the correlations 
which we could obtain. Nonetheless, we believe that it is worthwhile 
to search for any means by which the quality of teaching can be improved, 
even if the probable improvement will be slight. Hence, we think that 
even small correlations, if statistically significant, which suggest 
some causal relationships between certain behaviors of teachers in the 
classroom and the effectiveness of these teachers, are important. 

Two other caveats should be noted before the correlational analyses 
are presented. As with almost any analysis based on measures of association, 
there is a possibility that one is reversing the direction of a causal 
relationship in interpreting correlations--or that an obtained 
correlation is an artifact of each variable being caused by a third, 
common variable. However, until better evidence comes along, we believe 
that the best bet for the improvement of one's teaching is to work on the 
behaviors found here to be most closely associated with positive responses 
from students and supervisors. 

The second caveat has to do with the multiple regression equations 
primarily, with the simple correlations to a lesser extent. As with any 
multiple dimension analysis, the likelihood of interaction among the 
variables increases as the number of variables increases. With as many 
variables as were used in the multiple regression analyses described 
below, it is virtually certain that there is a certain amount of interaction 
which is reducing the obtained measures of association and which complicates 
interpretation. 
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Predictors of Supervisor Evaluation? . With 121 degrees of freedom, 
a product -moment correlation of approximately .23 is statistically 
significant at the .05 level of confidence. We found eight variables 
which were significantly correlated with supervisor evaluations.^^ 

As the first three correlations in Table XLV indicate, the more 
courses in vocational education that a teacher has had or the more years 
that he has been teaching his present subject or the more overall years 
of teaching experience he has had, the greater the tendency for him to 
receive lower ratings from his supervisor. Though the next two 
correlations are negative, they actually indicate a positive relation- 
ship with ratings on Dynamism and ratings on Delivery because, on the 
scales that made up those factors, 1 was the nK>st positive rating and 
S was the most negative. As noted earlier. Dynamism is the total for 
five ratings ("Keeps everyone busy," "General vigor and enthusiasm," 
"Skill at clarifying directions," "Appearance of self-confidence," 
and "Ability to create pleasant social -emotional climate") which were 
made for each teacher after observing him in the shop. The Delivery 
factor is made up of the total of four ratings ("Vocal loudness," 
"Vocal rate," "Fluency," and "Vocal variation"). 

When all of the independent variables were divided into two 
groups (the latter of which was comprised of the 24 shop communication 
items before they were combined into indices) and multiple regressions 
were done on each set, with supervisor evaluation as the dependent 
variable, multiple r's of .56 and .50 wei-e obtained. For the first 
multiple r, it took twenty variables to get up to .56. However, a 
multiple r of .50 was achieved by the time the first six variables 
were entered into the equation. These six, their regression coefficients, 
and the intercept are shown in Table XLVI. 

The direction of the relationship for each of these variables should 
be clear from the comments on the indivi^dual correlations, except for the 
regression coefficient for "Regret at being a teacher." The positive 
correlation indicates that the less a teacher regrets being in this 
profession the higher the supervisor rating tended to be. (On this 
teacher attitude factor, a high score indicated a favorable attitude.) 

For the second set of variables, con^rised of the shop communica- 
tion items by themselves, a multiple correlation of .45 was obtained by 
the time eight variables were entered in the equation. These and the 
intercept are listed in Table XLVII. 

When we recalculated the multiple regression using only those 
independent variables which we believe are under the control of a teacher 
most of the time, or on which he can improve w;th a reasonable amount of 
work, we obtained an r of .47 by the time we included nine variables. 
Additional variables made virtually no difference. Most of the variance 
could be accounted for by four variables, and a multiple correlation of 
.44 can be obtained using only those listed in Table XLVIII. 



TABLE XLV 

SIGNIFICANT CORRELATIONS BETWEEN 
SUPERVISOR EVALUATION SCORES AND OTHER VARIABLES 



Variable 


r with Supervisor 

cVo lUa V ion 


Courses in vocational education 


-.31 


Years teaching current subject 


-.32 


Years of teaching experience 


-.23 


Dynamism 


-.24 


Delivery- 


-.27 


Teacher contact time 


.24 


Average length of time of teacher- 
initiated contacts 


.26 


Number of minutes per hour spent in 
teacher-initiated ♦ student-initiated 
contacts 


.25 
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TABLE XLVI 



MULTIPLE REGRESSION EQUATION WITH SUPERVISOR EVALUATION SCORES 

AS THE DEPENDENT VARIABLE- 
ALL INDEPENDENT MEASURES 



Variable 


Regression Coefficient 


Years teaching current 




sub j ect 


-0.03x69 


Delivery 


-0.03548 


Teacher contact time 


0.03930 


Teacher attitude: Regret at being 




a teacher 


Oc 00897 


Courses in vocational education 


-0.01910 


Years of teaching experience 


0.02307 


Intercept 


2.80070 
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TABLE XLVII 



MULTIPLE REGRESSION EQUATION WITH SUPERVISOR EVALUATION SCORES 
AS THE DEPENDENT MEASURE- 
SHOP COMMUNICATION ITEMS 



Variable 


Regression Coefficient 


Average iGngm ox ^iine oz rea^cner** 
initiated contacts 


0.07483 


Percentage of students contacted 
during shop session 




Number of instances of banter per 
hour 




Nuiober of minutes per student per 
nour Ox toacner-iniL.-.area contacts 
with students 


0.13126 


Number of minutes per hour spent 
in teacher- initiated + student- 
initiated contacts 


-0.03239 


Average number of student-initiated 
contacts per hour 

• 


0.01406 


Nu("ber of teacher and student-initiated 
coiitacts per student per hour 


-0.06633 


Number of instances of positive re- 
inforcement per hour 


0.02743 


Intercept 3.61127 
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TABLE XLVIII 



MULTIPLE REGRESSION EQUATION WITH SUPERVISOR EVALUATION SCORES 
AS THE DEPENDENT MEASURE- 
VARIABLES UNDER TEACHER'S CONTROL 



Variable 


Regression Coefficient 


Delivery 


-0.01729 


Teacher contact time 


0.06455 


Percentage of students contacted 
during shop session 


-0.0r797 


Dynamism 


-0.02913 


Intercept 


4.77403 
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Predictors of Student Ratings. Only three individual variables 
were significantly correlated with the student rating of teacher score. 
(Recall that the mean rating of the teacher from the entire class was 
used as the rating measure.) These three are presented in Table XLIX. 

The correlations indicate that the more dynamic a teacher is, 
or the more his expressed attitude indicates a liking for students, or 
the more he creates a positive social -emotional climate in the shop 
through bantering with students and giving mere positive reinforcement, 
especially in relation to the amount of negative reinforcement, the 
more highly students will rate him as a teacher. 

As with the measure of supervisor evaluation, regression analyses 
were carried out to explore the combinations of independent variables 
which best predicted the student ratings. Initially, again, the analyses 
were done with each of two sets of independent variables so that all 
could be explored. With the first set of independent variables, a 
multiple r of .61 was achieved by the time we included eighteen 
independent variables, but the correlation was .51 with oniy six 
independent variables. Table L shows the six and the regression 
coefficients. With the next group of independent variables, the shop 
communication items, a multiple worrelation of .46 was obtained. It 
did not increase after the sev^enteenth variable was added. A 
correlation of .37 was obtained, though, with only six independent 
variables (Table LI). 

As with the supervisor ratings, we recomputed the regression 
equation using only independent variables which we believe are con- 
trollable by the individual teacher, this time with student rating 
as the dependent variable. Our maximum multiple r of .55 was obtained 
with twelve independent variables, but the first six alone brought 
the r up to .51. Ihese are shown in Table LI I. 

The only surprises in this regression equation are the direction 
of association indicated by the regression coefficients for Podily 
action and Appropriateness of language. According to these results, 
there is a tendency for teachers whom our observers rated as demonstrating 
better "bodily action" and more "appropriate language" to be rated lower 
as teachers by the students. "Model" gesture and language is, apparently, 
not reacted to as well by these students as we would have predicted. On 
the other hand, these students respond positively to a dynamic teacher, 
just as the supervisors do. (An interesting sidelight here is that 
Dynamism is positively correlated with both Bodily action and 
Appropriateness of language at a reasonably high level, .59 and .36 
respectively, but only Dynamism shows much relationship to student 
ratings when pairs of variables are correlated; and it is the only one 
of the three with a negative regression coefficient in the multiple 
regression equations using student rating as the dependent variable.) 
These students also respond positively to a positive social -emotional 
climate (described earlier in this section) and to the behaviors 
manifested by teachers with relatively positive attitudes toward them 
(the students) and toward the school. 

116 



ERIC 



TABLE XLIX 



SIGNIFICANT CORRELATIONS BETWEEN STUDENT EVALUATION SCORES AND 

OTHER VARIABLES 



Variable 


r With Student Evaluation 


D/namism 


-.35 


Teacher attitude: Liking for 




students 


-.26 


Positive reinforcement index 


.24 



TABLE L 

MULTIPLE REGRESSION EQUATION USING STUDENT EVALUATION SCORES 

AS THE DEPENDENT MEASURE- 
ALL INDEPENDENT MEASURES 



Variable Regression Coefficient 


Dynamism 


-0.62625 


Bodily action 


1.51998 


Teacher attitude: Liking for students 


-0.15594 


Appropriateness of language 


1.27484 


Teacher attitude: Satisfaction with the 
school 


-0.04523 


Positive reinforcement index 


0.20128 


Intercept 


49.53261 
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TABLE LI 



MULTIPLE REGRESSION EQUATION WITH STUDENT EVALUATION SCORES 
AS THE DEPENDENT MEASURE— 
SHOP CO^MUNICATION ITEMS 



Variable Regression Coefficient 


Number of instances of banter 
per hour 


0.21178 


Average niunber of minutes per hour 
that students spent in their initiated 
contacts with teacher 


1.06706 


Positive/Negative reinforcement ratio 


0.20080 


Average length of time of teacher- 
initiated contacts 


0.96017 


Percentage of students contacted 
during shop session 


0.11091 


Number of student-initiated contacts 
per hour 


0.10670 


Intercept 


30.40120 
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TABLE LI I 



MULTIPLE REGRESSION EQUATION WITH STUDEOT EVALUATION SCORES 
AS THE DEPENDENT MEASURE- 
VARIABLES UNDER TEACHER* S CONTROL 



Variable 


Regression Coefficient 


Dynamism 


-0.62625 


Bodily action 


1.51998 


Teacher attitude: Liking for students 


-0.15594 


Appropriateness of language 


1.27484 


Teacher attitude: Satisfaction with 
the school 


-0.04523 


Positive reinforcement index 


0.20128 


Intercept 


49.43261 
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Predictors of Drop Rate . Six significant correlations were 
found between drop rate and our independent variables (Table LI II). 

Interestingly, as those correlations show, the teacher whose 
class is interrupted more often or for a greater proportion of his 
class period because of outside visitors, telephone calls, etc., 
tends to have a higher student drop rate. In addition, the teacher 
who gives more negative reinforcement aaid regrets being a teacher has 
a higher drop rate. Less understandable is the positive correlation of 
drop rate with the teacher's age and with the index of contact time 
between the teacher and individual students. 

The regression analyses are even less helpful in explaining 
drop rate, even though with the first set of independent variables we 
were able to obtain a correlation of .63 with 23 variables, .55 with 
seven. The seven are presented in Table LIV. With the next group 
of independent variables, the multiple correlation reached .51 with 
sixteen variables, but .44 with three. These three are shown in 
Table LV. 

Additional regression analyses attempting to explain drop rate 
did not appear to us likely to be fruitful. On the basis of the 
analyses just reported, considering only those behaviors which a 
teacher might be able to change, it appears that the Industrial 
Education teacher might reduce drop rate somewhat by reducing the 
amount of class time wasted by outside interruptions and by reducing 
rhe use of negative reinforcement. These findings appear to have 
some face validity. On the other hand, the relationships of drop 
rate with the other variables ranking high in these regression 
results seem to us inexplicable at the moment. On the basis of the 
data that we have to date, we are not able to satisfactorily explain 
why there is a tendency for drop rate to increase with the teadier's 
better use of his voice and with the more status that he perceives 
I.e has as a teacher. 

Predictors of Absenteeism . We were even less successful at 
shedding new light on the problem of absenteeism with our regression 
analyses. The reason is obvious when one considers the individual 
independent variables that correlated significantly with absenteeism. 
There '-'ere three of them (Table LVI). 

As these data indicate, the major portion of the variance in 
absenteeism is due to the age and grade level of the students, rather 
than to any of the behaviors of the teachers which we examined. 
(Noise level is positively correlated with the age of the students 
in the class.) Therefore, additional regression analyses did not 
appear to us to be worthwhile. 

Miscellaneous Correlations among Independent Variables . It 
may be interesting, if not useful, to examine the relationships among 
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TABLE LI I I 

SIGNIFICANT CORRELATIONS BETWEEN DROP RATE AND OTHER VARIABLES 





r with DroT) Rate 


NuBiheT of iTii flutes tjeir houT S^Gllt 
in interruptions 


.32 


Age of teacher 


.29 


Number of instances of negative 
reinforcement per hour 


.27 


Number of interruptions per hour 


.26 


Average time of student -initiated 
contacts 


.25 


Teacher attitude: Regret at being 
a teacher 


-.23 


TABLE LIV 




MULTIPLE REGRESSION EQUATION WITH DROP RATE AS THE DEPENDENT MEASURE- 
ALL INDEPENDENT MEASURES 


Variables 


Regression Coefficient 


Age of teacher 


0.37435 


Delivery 


-1.65280 


Teacher attitude: Regret at being 
a teacher 


-0.65668 


Years of education beyond 
secondary level 


-2.33098 


Years teaching current subject 


0.43453 


121 





TABLE LIV— Continued 





D^ot^nkcci At) P 4^4^*1 ^^i Ant* 


Average age of students in the class 


-0.34002 


Teacher attitude: Perception of 
status 


-0.54613 


Intercept 


43.96429 


TABLE LV 




MULTIPLE REGRESSION EQUATION WITH DROP RATE AS THE DEPENDENT MEASURE- 
SHOP COMSflJNICATION ITEMS 


Variable 


Regression Coefficient 


Number of minutes per hour 
spent in interruptions 


0.74154 


Number of instances of negative 
reinforcement per hour 


0.29370 


Number of minutes per hour spent 
in teacher- initiated.* student- 
initiated contacts 


0.22632 


Intercept 


-2.44207 
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TABLE LVI 

SIGNIFICANT CORRELATIONS BETWEEN ABSENTEEISM AND OTHER VARIABLES 



Variable r with Absenteeism 

Average age of students in the class 
Grade level of student 

Noise level in the classroom 
(the lower the score, the 
greater the noise) 



-.35 
-.35 

-.25 
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some of the independent measures also. Those which we believe should 
be of concern to teachers and administrators are listed in Table LVII. 

One set of correlations which we found somewhat surprising are 
those involving amount of education and training. The training and 
euacation measures, which were correlated with each other, were not 
correlated significantly with much else besides age. For example, 
the only other variable we found correlated with professional 
experience was age (r = .55), 

The positive relationship between positive and negative rein- 
forcement we believe is especially worth noting here, as well as with 
the posit ive/negative reinforcement ratio and total amount of rein- 
forcement. Negative reinforcement was correlated at a lower level 
with these latter two measures. These findings indicate that the 
teacher who gives more reinforcement overall, will tend also to make 
a greater proportion of that reinforcement positive. The less rein- 
forcement he gives, the greater the probability that it will be negative 
when he does give it. 

The fact that the class time eroded by interruptions is associated 
with length of time one has been at a school or with age is not surprising, 
nor especially distressing. What is distressing is the clear indication, 
though again not a surprising one, that what tends to get lost when 
there are many or prolonged interruptions is the interaction with individual 
students and the kind of teacher-student relationship which leads to banter. 

Measures of Communication Skill . Because of our interests in 
communication and our belief that certain of the skills of communica- 
tion are extremely important for the teacher, we examined the relation- 
ship among our four measures of these skills and between each of them 
and our other variables. As the matrix of correlations in Table LVIII 
shows, the various communication measures, wi*-h the exception of 
Appropriateness of language, were closely related, even though the 
I^amism measure came from observation of the teacher's behavior in 
the shop and the other measures came from observation of his presentation 
in the classroom as well as in the shop. The lack of relationship 
between the use of language and the other communication skills is 
consistent with the findings in other communication studies. 

More interesting are the relationships between each of these 
communication measures and other measures obtained in this study. These 
are shown in Table LIX. As these lists show, of the four communication 
measures, only Dynamism and Delivery were significantly correlated with 
a meaningful number of other variables. Bodily action was correlated 
with none. More important, as shown earlier in these results, only 
Dynamism and Delivery were significantly correlated with supervisor 
evaluation scores. Still more important, of all of the many variables 
included in this study. Dynamism was the only one found to correlate 
significantly with both Supervisor Evaluations and Student Evaluations . 
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TABLE LVri 



CORRELATIONS AMONG VARIOUS ASPECTS OF 
TEACHERS* AND STUDEOTS* BACKGROUND? AND BEHAVIOR 



Variable 


r 


Years of Education Beyond Secondary Level 


Courses in vocational education 


.48 


Courses in communication 




Courses in psychology 


.61 


Years of teaching experience 


.44 


Years teaching current subject 


.32 


Courses in Vocational Education 


Supervisor evaluation scores 


-.31 


Years of education beyond secondary level 


.48 


Courses in psychology 


.51 


Teaching experience 




Years teaching current subject 


.69 


Years at this school 


.41 


Age of teacher 


.38 


Number of minutes per hour spent in 
interruptions 


.25 


Courses in Communication 


Years of education beyond secondary level 


.44 


Courses psychology 


.34 
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TABLE LVI I— Continued 



Variable 


r 




Courses in CoBiimuiication 


Number of minutes per hour of 
student- initiated contacts with 
teacher 


.29 




Highest Grade Level Attained by Students of Teacher 


Absenteeism 


-.35 




Age 


.68 




Number of teacher-initiated contacts 
per hour 


-.27 




Average length of time of teacher- 
initiated contacts 


.25 




Number of student- initiated contacts 
per hour 


-.25 




Average length of time of student - 
initiated contacts 


.27 




Number of teacher and student-initiated 
contacts per hour 


-.33 




Number of teacher and student -initiated 
contacts per student per hour 


-.26 




Number of Instances of Positive Reinforcement per Hour 


Number of instances of banter per hour 


.49 




Niimber of instances of negative 
reinforcement per hour 


.23 




Positive/Negative reinforcement ratio 


.77 
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TABLE LVI I— Continued 



Variable 


r 


Number of Instances of Positive Reinforcement per Hour 


Number of instances of positive and negative 
reinforcement per hour 


.89 


Dynamism 

And positive correlations with most of 
the measures of teacher and student 
interaction 


-.34 


Number of Minutes per Hour Spent in Interruptions 


Years at current school 


.29 


Age of teacher 


.27 


Courses in vocational education 


.25 


Positive reinforcement index s 


-.25 


Banter 


-.29 


. Percentage of time teacher kept an 
obstacle between himself and his 
students 

And negative correlations with most of 
the measures of contacts with students 


.68 
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TABLE LVIII 

CORRELATIONS AMONG FOUR MEASURES OF COMMUNICATION SKILLS 





Dynamism 


Attn vAnTl al! eness 

of language 


Delivery 


Appropriateness of 
language 


.36 






Delivery 


.56 


.21 




Bodily action 


.59 


.15 


.67 



TABLE LIX 

CORRELATIONS OF DYNAMISM, DELIVERY, AND APPROPRIATENESS OF LANGUAGE 

WITH OTHER COMMUNICATION VARIABLES 



Variable 


r 


Dynamism 


Supervisor evaluation score 


-.24 


Student evaluation score 


-.35 


Teacher attitude: Liking for students 


.31 


Number of instances of positive 
reinforcement per hour 


-.34 


Positive/Negative reinforcement ratio 


-.23 


Number of instances of pOi>itive aiid 
negative reinforcement per hour 


-.32 
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TABLE LIX— Continued 



Variable 


r 


Delivery 


Supervisor evaluation score 


-.27 


Noise level in the classroom 


-.36 


Niamber of instances of negative rein- 
forcement per hour 


-.26 


Number of minutes per hour spent in 
student-initiated contacts with 
teacher 


-.25 


Number of minutes per hour spent in 
teacher- initiated and student - 
initiated contacts 


-.25 


Appropriateness of Language 


Teacher attitude: Liking for students 


.24 
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The rest of the correlations shown indicate that the teacher 
rated as dynamic also tended to .dicate a greater liking for students, 
gave more positive reinforcement students, more negative reinforce- 
ment, and a higher ratio of posit-.«e to negative reinforcement. 

The teacher rated as having better delivery tended to spend more 
time in individual contacts with students, tended to give more negative 
reinforcement, and tended to have a quieter classroom than did the 
teacher rated as having poor delivery. 



FOOTNOTES 



The minimum eigen value was set at different levels to 
determine the factor structure that was most meaningful. For the 
factor analyses of communication measures reported in this section, 
the value used was 1.0. 

^Only 57 teachers had a formal classroom session; therefore, 
the data from the classroom rating scales were subjected to a separate 
factor analysis. Omitting the items concerning voice quality, the 
remaining items loaded on a single factor. Thus, the index of 
"Skill in Conducting a Classroom Session" was comprised of all the 
items except those concerning voice quality. (The only other 
exception was the scale "use of visual aids/models" which was 
scaled from "often" to "never" and was analyzed separately from 
the interval scale data.) 

-^A factor analysis of the supervisor evaluation data revealed 
only one factor. Correlations among the five items comprising the 
instrument ranged from .32 to .59. Each coefficient was significant 
beyond the .01 level of confidence. 

^Differences in student evaluation scores among the three 
groups were not significant, although the differences were in the 
expected direction. 

^To preserve parsimony, we included in this section the results 
of only those kinds of analyses that were most useful to our under- 
standing of the relationship between communication and teaching 
effectiveness. Other types of analyse^ involving the kinds of behavior 
for which a teacher showed enthusiasm, the heterogenity of activities 
in the shop, etc., were undertaken, but they did not indicate an 
association between the particular variable (e.g., heterogenity of 
activities) and the teaching effectiveness criteria. 

^The Fischer t, was used for all post-hoc analyses. To minimize 
the probability of a Type 1 error, whenever more than three groups 
were analyzed, the accepted level of significance was raised to .01. 

^Two other analyses of variance, one for the percentage of 
time a teacher kept an obstacle between himself and his students and 
the other for the average noise level in the classroom, were performed; 
but neither was significant. 
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^The student evaluation data were factor analyzed, and two 
factors, shown below, emerged. 





Statement Concerns : 


Factor 1 


Factor 2 


1. 


. . ■ ■ ' ' ., ■ ■ . — 

teacher's interest in his work 


.77* 


.26 


2. 


teacher's awareness of safety procedures 


.13 


.86* 


3. 


teacher's respect for students 


.87* 


.25 


4. 


teacher's punctuality 


.44 


.44 


5. 


teacher's dress 


.38 


.62* 


6. 


teacher's genuine interest in students 


.88* 


.14 


7. 


teacher's organization ability 


.73* 


.34 


8. 


value of program to student 


.23 


.73* 


9. 


relative effectiveness of teacher 


.73* 


.54 




compared to other teachers 







♦Loads heaviest on this factor. 



Items comprising the first factor are directly related to teaching 
ability, while items from the second factor denote qualities of the 
teacher that are indirectly related to his teaching ability. One 
item, punctuality, loaded equally on both factors. Despite the 
emergence of two factors, the correlation between factors (r « .92) 
and the correlation matrix of the individual- items suggested that a 
valid student evaluation score could be derived by combining all the 
item scores into a single index. 

^•he supervisor evaluation scores for these three groups of teachers 
were very similar; 2.59 for teachers in both the high and moderate 
evaluation groups, and 2.45 for teachers in the low evaluation group. 

l^The items that were not combined irto indices, such as the ones 
found in Table IX, were included in the simple and multiple correlation 
analyses. 
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SUMMARY, CONCLUSIONS § RECOJWENDATIONS 



Suiaroary 

The purpose of our study was to gain a better understanding of 
how comniunication relates to teaching effectiveness in the setting of 
vocational education. We defined teaching effectiveness in terms of 
four criteria: 1) supervisor evaluations of teachers, 2) student 
evaluations of teachers, 3) absentee rate, and 4) drop rate. The focus 
of our study was the vocational education teacher, whose behavior and 
attitude determine to a great extent the quality and quantity of learning 
that takes place in the classroom. Since few studies had analyzed communi- 
cation in the vocational setting (especially the shop situation) and 
even fewer had attempted to relate classroom communication to teaching 
effectiveness, we proceeded in a manner which might be described as 
macroscopic. 

Using direct observation as a means of collecting data, we developed 
a number of instruments to tap various aspects of verbal and nonverbal 
communication. One of the instruments took into consideration the 
frequency and duration of contacts between the teacher and his students, 
the amount and kind of praise and criticism that the teacher gave, the 
amount of time spent in interruptions, and the number of times the 
teacher engaged in banter with his students. Another instrument was 
designed to assess the teacher's organization and presentation skills, 
and the degree to which he displayed enthusiasm and self-confidence as 
he conducted his class. Additional measures of behavior, e.g., the manner 
in which students were addressed, the heterogenity of shop activities, 
etc., were included, along with a measure of the teacher's attitude 
toward various aspects of teaching, to give as complete a picture of 
the communication environment as was possible. Finally, these measures 
were supplemented by information about the teacher's background, his 
program, and students, and by a narrative account of the day*s activities. 
The purpose of the narrative was to give a description of the overall 
style of the teacher and the perceived relationship between him and his 
students . 

We selected as subjects for our study teachers from a number of 
Industrial Education programs whose shop and classroom activities were 
conducted in a relatively similar manner. The majority of the teachers 
taught in mechanics -type programs such as Auto Mechanics and Air Conditioning 
and Heating Mechanics. Most of the remaining teachers came from Machinist 
and Welding programs. The teachers were located in three types of schools: 
secondary schools, vocational -technical centers, and community colleges. 
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Two trained observers spent two days with each teacher recording 
his behavior and the behavior of his students. The primary measures 
used in our analyses were the averages of the two days' data. The ob- 
servers collected data in 14 counties throughout the state. While most 
of the counties were located in the northern portion, we selected an 
equal number of teachers from the northern half of the state (using Orange 
County as the dividing line) and the southern half. It took approximately 
eight months to collect the data. 

Once the data were collected, we did several factor analyses and, 
on the basis of the results, combined the data into various indices of 
communication and attitude. We then performed two kinds of analyses: 
1) one-way analyses of variance in which we separated teachers into high, 
moderate, and low groups (using the scores on each teaching effectiveness 
criterion as the basis for grouping) and determined which communication 
skills and dimensions of teacher attitude discriminated among the three 
groups of teachers; and 2) multiple regression analyses which allowed us 
to select from the various measures of communication, attitude, and 
information about the teacher, his program, and his students, the best 
predictors of each teaching effectiveness criterion. In addition to 
these, we separated teachers according to the size of their classes 
and the race of the teachers and their students and analyzed the effects 
of each of these variables upon certain aspects of communication. 

The results of our analyses underscored the iu^ortance of communica- 
tion skills in the teaching/learning process. The most critical measures 
of communication, or at least the most critical of the ones we selected 
for study, had to do with how dynamic the teacher was (i.e., how well he 
could move about the shop in a manner that conveyed self-confidence, 
organizational ability, and enthusiasm); how well he could present his 
material (his delivery); how much time he spent with his students; and 
how often he praised their work and bantered with them. 

Although we selected four criteria as indicators of teaching 
effectiveness, only two of them, supervisor and student ratings of 
teachers, were useful to our determining the relationship between 
teaching effectiveness and communication. The other two criteria, drop 
rate and absentee rate, were primarily related to the age of the teacher 
and the age of his students. They had little to do with his communication 
behavior. 

In terms of communication and attitude, supervisors and students 
differed somewhat in their criteria for evaluating teachers. Whereas 
supervisors placed importance upon the teacher's delivery skills, his use 
of gesture and eye contact, and the time that he spent in direct contact 
with his students, the students were concem*»d with the teacher's attitude 
toward them and the kind of social -emotional environment he created in the 
shop. According to our analyses, teachers with high supervisor ratings 
(and sometimes even those with moderate ratings) had significantly better 
delivery skills than teachers with low supervisor ratings. Also, they 
displayed more eye contact and more skillful use of gestures and spent 
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significantly more time in direct contact with their students. The 
teachers who received high ratings from the students gave significantly 
more positive reinforcement and expressed significantly more favorable 
attitudes toward their students than teachers who received low student 
ratings. 

The two aspects of communication which discriminated highly rated 
teachers from lowly rated ones for both supervisor and student evaluations 
were Dynamism in the shop and Classroom Skills ( a measure of control 
and clarity) . Since several of the items in these indices were similar 
(e.g., appearance of self-confidence and enthusiasm) we assume that they 
were measuring roughly the same skills in different contexts. Therefore, 
it is not surprising that if one of these indices discriminated between 
good and poor teachers, the other would also. 

Besides analyzing the data according to supervisor evaluation 
and then student evaluation scores, we also used a combined supervisor 
and student rating as a means of grouping teachers and reanalyzed the 
data. As might have been expected, most of the significant differences 
in communication and attitude were found between the two extrefime groups, 
i.e., those teachers who had received high supervisor and student ratings 
and those who had received low ratings from both supervisors and students. 

The distinctions between these two groups of teachers were clear 
not only in our analyses of variance but also in the narrative descrip- 
tions of their shop and classroom sessions. Because the narratives 
paralleled so closely what we found in our statistical analyses, we 
will use them as a basis for summarizing the dil'ferences between the 
two groups. (Examples of the narrative accounts are found in Appendix M.) 

As indicated earlier, each observer wrote a narrative description 
at the end of each day of what had gone on in the class that he had been 
obsexving. While he obviously was influenced by the data he had recorded, 
he did not know how the teacher of the class had been rated by his super- 
visor or students. Although student evaluations of teachers were filled 
out at the end of the second day and could have possibly affected the 
second day's description, the summaries show that the most detailed 
account of shop and classroom activities was given for the first day's 
session and that the second day's account simply noted whether any 
differences in overall behavior had occurred. 

One of the most frequent comments in the narratives about the 
teachers with high ratings is that the teacher constantly moves about 
the shop, from one group to another. On the other hand, the comment on 
many of the narratives for the teachers wi*' low ratings is that the 
teacher simply sits in his office for long stretches of time or in 
other ways ignores many of the students. 

The relationship between the highly rated teachers and their 
students is continually described as warm and supportive, though not 
"buddy-buddy." These teachers tend to be addressed respe-."nlly as 
Mr. and, in turn, address students by their first nam^s or nicknames. 
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On the other hand, there is a great deal of positive reinforcement and 
a certain amount of banter employed by almost all of these teachers. 
The narratives note that when they do give negative reinforcement, which 
is infrequently, it is consistently done gently; as one observer said 
of one of the highly rated teachers, "He is both niggardly and gentle 
with his criticism and quick and generous with praise." In the narratives 
about the teachers with low evaluations, on the other hand, the observers 
noted many instances of strong, unpleasant negative reinforcement. For 
example, one observer wrote about a student who was working on a project 
and who appeared nervous and lacking in self-confidence. The teacher 
of the class, instead of showing an awareness of the student's problem, 
yelled at him and chastized him for his poor work. 

The observers noted that many of the teachers in the. l»ow evalua- 
tion group disp-layed little enthusiasm or concern for their work and 
tended to ignore students who were "goofing off" either inside the shop 
or outdoors. No instance of this was noted in the narratives about the 
highly rated teachers. On the contrary, it was repeatedly noted that 
they were serious about the work being done. They also tended to display 
confidence in the ability of their students to do anything. Quite a 
few of these highly rated teachers were reported to be using some form of 
the Socratic method in their teaching- -asking questions or posing problems 
which students could figure out, rather than simply providing answers or 
telling students what to do. Sometimes when students had difficulty 
finding solutions, the observers noted that the teacher would give them 
clues, but no answer. The only negative observation about one of the 
teachers in the high evaluation group was that although he was quite 
good in the classroom, he was disorganized in the shop. 

In reading both the positive and negative narratives, one can 
perceive an interesting and important phenomenon which is going on in 
those classes; the students--consciously or unconsciously--tend to model 
themselves after the teacher, whether that teacher is good or bad. For 
example, in the classes where the teacher is constantly moving and busy 
and interested in his work, the students tend to keep busy and interested; 
where the teacher appears to waste a great deal of time, many of the 
students tend to waste a great deal of time. In one class where the 
teacher often yells at the students, the students tend to yell all the 
time also. Of all the lessons to be gained from our study, this may be 
the most important of all: that one of the good ways for a teacher to 
get students to work and otherwise act in particular ways is to work 
and act in those ways himself. 

After analyzing the data according to the combined supervisor and 
student ratings, we groitped teachers according to the <ize of their classes 
and found that most of the significant differences in frequency and duration 
of contacts (the only aspects of communication we investigated in relation- 
ship to class size) were between the smallest class size group (less than 10 
students) and the others. While teachers with the fewest students spent 
more time in contact with each student, the teachers and students in the 
larger classes made significantly more contacts per hour. For class sizes 
of 11 - 14 students, 15 - 18 students, and 19 or more students, the 
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differences in frequency und duration of contacts* even when adjusted 
for the number of students in the class, were negligible. 

No significant differences were found for frequency and duration 
of contacts when teachers and students were grouped according to race; 
however, only four black instructors had a sufficient proportion of black 
and white students in their classes to be included in the analyses. We 
noted, in a series of graphs, the tendency of black and white instructors 
and black students to interact most frequently with members of their own 
race. The white students, on the other hand, interacted somewhat more 
with black instructors than with the white ones. 

The regression analyses gave us a slightly different way of 
looking at the relationship between communication and teaching effective- 
ness. In these analyses, we attempted to find the best predictors of 
each teaching effectiveness criterion, thereby enabling teachers to know 
what skills probably best lead toward improving the quality of their 
teaching. Interestingly, when we used the background information of 
teachers as well as the communication indices as independent variables, we 
found that the longer a teacher had been teaching, the less likely he was 
to have received a high rating from his supervisor. On the other hand, 
the better the teacher's delivery skills and the more time he spent in 
direct contact with his students, the more likely he was to have received 
a high supervisor rating. 

The best predictor of student evaluations of teachers was Dynamism. 
The more dynamic the teacher, the higher the chances were that he received 
a high student rating. Although most of the relationships between 
communication skills and student evaluation scores were in the direction 
we expected (the more positive reinforcement that was shown the higher 
the student ratings of the teacher, etc.), two of them — Bodily Action 
and Appropriateness of Language were not. For these two variables, 
the teachers with the more favorable scores received lower student ratings. 
Thus, what we perceived as "model" gestures and language were not perceived 
so by these students. 

The predictors that we found for drop rate and absentee rate were 
much less understandable than the predictors of supervisor and student 
ratings of teachers. On the basis of the analyses we made, it appeared 
that teachers might reduce drop rate somewhat by decreasing the amount of 
time they spend in interruptions and by decreasing their use of negative 
reinforcement. We had no suggestions for reducing absenteeism since the 
variables that correlated significantly with it were not related to 
communication skills, but instead to the age and grade level of the 
students . 

Conclusions 

We may conclude from this study that there are identifiable differences 
in behavior among teachers who are categorized according to their supervisor 
and/or student ratings. While no doubt each teacher has a somewhat unique 
style or approach to teaching, the "best" teachers are characterized by 
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being very dynamic, by having superior delivery skills* by spending a 
great amount of time in direct contact with their students, and by 
creating a pleasant social-emotional environment through the use of 
positive reinforcement and banter. Each of these characteristics, as 
well as a positive attitude toward students, is an important determinant 
of favorable supervisor or student ratings. Only Dynamism, however, is 
an important determinant of both. 

As we noted at the beginning of this report, few communication 
guidelines -exist for aspiring or practicing vocational educators. Not 
only have previous studies of teacher- student interaction generally 
ignored the vocational setting, they have also failed to examine the 
relationship between communication and teaching effectiveness. Despite 
the limitations of our criteria for effective teaching, we have hopefully 
taken a step toward providing a useful understanding of communication 
in the teaching/ learning process, especially as it occurs in the kinds 
of programs found in Industrial Education. 

Recommendat ions 

We noted at the beginning of this report the need for effective 
communication in the classroom and the dearth of knowledge about communi- 
cation in the vocational education setting. The initial step toward 
understanding the role of communication involved determining those 
behaviors that relate to teaching effectiveness. Given the limitations 
of our efforts to make such determinations, including the assumption 
that our data are valid and reliable, we believe that the following 
recommendations are warranted. 

1) The usefulness of our research depends ultimately upon the 
changes that a teacher makes in his behavior in order to become a 
better teacher. We therefore recommend that a population of Industrial 
Education teachers similar to the * ^achers who received low ratings 
(from supervisors or students) in our study be identified and invited 

to participate in an experimental teacher-training program in communica- 
tion. A systematic study of changes in the teachers* behavior and 
consequent changes in their supervisor and student ratings would determine, 
in part, the validity of our findings and their usefulness as a guide in 
training teachers to become more effective communicators. 

2) We believe that the findings of this report should be disseminated 
to all Industrial Education teachers. However, due to the technical nature 
of this monograph, we suggest that an additional report, written in layman's 
terminology, be prepared. 

3) In Older to maximize the utilization of out data, we believe 
that additional data should be collected from our sample of teachers and 
analyzed in relation to the data that already exist. For example, due to 
the numerous other instruments that had to be administered, we did not 
include a measure of self-concept. This personality variable, or its 
evaluative component, self-esteem, might prove to be an important 
determinant of communication. Indeed, previous studies have shown that 
perceived success in communication effects at least temporary changes in 
self-esteem. ^ 
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4) We recommend the development of additional "teaching effective- 
ness" criteria for the evaluation of vocational education programs. As 
mentioned earlier in the report, we would like to have had a measure of 
student achievement in the classroom or an employer's performance 
evaluation of a teacher's previous students as further indications of 
successful teaching. Such criteria might include not only skills- 
related measures but also measures of change in values, interests, 

and attitudes, the necessary concomitants of the acquisition of a 
skill. Improved criteria of teaching effectiveness, we believe, are 
important for the improvement of instruction. 

5) Because of the uniqueness of the shop and classroom activities 
in the programs we studied, we cannot at this time generalize our findings 
beyond the area of Industrial Education. Therefore, we believe that a 
replication of our study should be made for the other areas of vocational 
education, e.g.. Business Education, Home Economics, etc. Results from 
studies in these areas will facilitate a more unified appreach to the 
development of pre-service and in-service teacher -training programs in 
communication of the sort that we suggest in our sixth recommendation. 

6) So far as we know, there is no course in communication designed 
specifically for the vocational education teacher. We believe, however, 
that such a course could be constituted, at least for Industrial Education 
teachers, from the data we have collected. Once studies have been 
conducted in other areas of vocational education, similar courses could 
be developed. Ultimately, consideration should be given to incorporating 
such courses into the certification requirements of vocational educators. 

7) We recognize that the value of a vocational program is related 
in many ways to factors beyond the teacher's control. Some of these 
factors involve communication. For instance, students communicate during 
the day not only with teachers but also with other students, counselors, 
and administrators. Their relationships to these groups may determine 

to some extent their attitudes toward the program and the degree to which 
they are motivated to acquire a skill. Thus, we recommend that studies 
be conducted at other levels of communication besides the classroom. 
Such studies may focus upon administrators and various aspects of 
organizational communication, or upon students and their interactions . 
with counselors, administrators, and other students. In sum, we are 
suggesting that the most fruitful approach to understanding communication 
in vocational education is to consider the total communication environment. 
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FOOTNOTE 



^ee, for example, Churchill Roberts, "The Effects of Self- 
Confrontation, Role Playing, and Response Feedback on the Level of 
Self-Esteem," The Speech Teacher , XXI (January. 1972), 23-37. 
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COUNTY 



SECONDARY SCHOOLS 



AREA SCHOOLS AND 
•'XATIONAL-TECHNICAL CENTERS 



COMMUNITY 
COLLEGES 



Alachua Lincoln Center Voc-Tec 

Gainesville^ Florida 

Brevard Melbourne Hxgh School 
Melbourne, Florida 

Eau Gallic High School 
Eau Gallie, Florida 

Satellite High School 
Satellite Beach, Fla. 

Satellite Beach High 
Satellite Beach, Fla. 

Cocoa Beach High 
Cocca Beach, Fla. 

Rock ledge High School 
Rockledge, Fla. 

Titusville High School 
Titusville, Fla. 

Columbia Lake City 

Community 
College 

Lake City, Fla. 

Dade Hialeah High 
Hialeah, Fla. 

Miami Carol City 
Senior High 
Opa Locka, Fla. 

Miami Central High 
Miami, Fla. 

South Dade High 
Homestead, Fla. 

Lindsey-Hopkins Voc-Tec 
Miami, Fla. 

George T. Baker Aviation 
Miar.i, Fla. 

Miami Central Adult Ed. 
Miami, Fla. 
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AREA SCHOOLS AND CO^WUNITY 
COUNTY SECONDARY SCHOOLS VOCATIONAL>TECHNICAL CENTERS COLLEGES 



Duval Ribault Sr. High 
Jacksonville) Fla. 

Raines High School 
Jacksonville, Fla. 

Forrest High School 
Jacksonville, Fla. 

Englewood High School 
Jacksonville, Fla. 

Stanton High School 
Jacksonville, Fla. 



Technical High #67 
Jacksonville, Fla. 



Florida Jr. 
College 
Jacksonville, 
Fla. 



Escambia 



George Stone Voc-Tec 
Pensacola, Fla. 



Hillsborough 



Tampa Bay Voc-Tec 
Tampa, Fla. 



Pensacola Jr. 
College 

Pensacola, Fla. 



Jackson 



Chipola Jr. 
College 
Marianna, Fla. 



Marion Forest High School 
Ocala, Fla. 

Vanguard High School 
Ocala, Fla. 



Okaloosa 



Central Florida 
Community 
College 
Ocala, Fla. 

Okaloosa-Walton 
Junior College 
NiccvUle, Fla. 
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COUNTY sncoN'OAPvY saioois 



^RE^ SCHOOLS AND 

VOCATIONAL -TEQIN I CAL CENTERS 

Mld-Fla. Technical 
Orlando, Fla. 



CONtMUNITY 
COLLEGES 



Pinellas 



Santa Uosa Jay High School 
Jay, Fla. 



Milton High School 
Milton. Fla. 



Taylor 



Pinellas Voc-Tec 
Clearwater* Fla. 

City Center for Learning 
St. Petersburg, Fla. 



Taylor County Voc-Tec 
Perry, Fla. 
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LETTER OF INVITATION TO PARTICIPATE IN STUDY 



145 



ERIC 



1 5"^ >>, BEST COPY AVAIUBLE 

•p^S^'-}^ State of Fl.orida 



Jc 



Department of Education 

OT. CHRISTIAN TAllAMASSIE 32304 «^rt?,??' 

August 15, 1972 '^'^Vi^iit]:^:::'^'^-'^' 



Dr. T. Pelton Harrison, President 
Pensacola Junior College 
1000 College Boulevard 
Pensacola, Florida 32504 

Dear Dr. Harrison: 

This letter is to invite the participation of your 
institution in a research project, "Communication Prob- 
lems of Vocational Kducators in the State of Florida, 
funded throuf;h a grant from this office, and directed by 
Dr. Churchill Roberts, Assistant Professor of Communication 
Arts at the University of VJest Florida, Pensacola. 

Dr. Roberts is selecting and evaluating; instruments which 

sLillc thrcu-h the" -y^ter.atic observation of teacher be- 
haviors. He hoDes to study approximately 120 teachers 
randomly selected from t.he following Industrial Education 
programs: Air Conditioning and Heating .'Mechanics, Automo- 
tive Body Repair and Hefinishing, Automotive Mechanics, 
Aviation Mechanics, riachine Shop Work, Marine Engine 
Mechanics, and V/elding. 

Present plans call for an observer (data gatherer) to spend 
two days with each teacher who agrees to participate in ti- 
studv. The data collecting phase will begin in October and 
take" approximately seven (7) months. Results from this 
study will serve as a basis for developing pre-service ana 
in-service teacher training programs devoted exclusively to 
problems of communication among vocational educators. 

If you agree to participate in the study, please send a letter 
from your office* to Dr. Roberts granting permission to 
^^.„<.,.^4- ^unior oollo,';c dean of vocational- technical 

education 'inviting participation in the study. The letter 
should name a contact person in your institution to assist 
Dr. Roberts v;ith hir. ctudy. Follcwinr: an c::TDlanaticn of "^r.c 
study, those administrators who agree to participate will 
submit an evaluation of teachers in selected programs. 
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Dr. T. Felton Harrison 
Page 2 



Prom this list the final teacher sample will be drawn, and 
teachorD will be contacted and invited to participate in the 
study. Data will be collected from teachers agreeing to 
participate. 

Boforo data are collected, copies of all proposed instruments 
to be \M'e'\ will be submitted for your approv-?!. 

Your continued cooperation and leadership in the improvement 
of vocational education is appreciated. 




[Jde D. Mills, Director 
Volcationnl Technical and 
Awilt Education 



JDM:VB:bh 
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NOTIFICATION OF ACCEPTANCE TO PARTICIPATE IN STUDY 
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Mr. CiH C. FMMitth 
F. 0. Box 293 
Iteddkk* Flodda^2686 



Mr. hmih C. Tmm 
119S 8. S. 7tfi Stmt 
<tatft« FkKkU 32070 
VIm Cbairatta 



MARION COUNTY SCHOOL BOARD 
P. O. Box 670 Phone 629-8041 
512 S. E. 3rd Street 
OCALA, FLORIDA 32670 

August 25, 1972 



Dr. Churchill Roberts 

Assistant Professor of Communication Arts 
University of West Florida 
Pensacola, Florida 32501 

Dear Dr. Roberts: 



Mr« Jtey AodifftPti 
P« 0« Bom 07 

Ihrnmillftn, FlotM* 336)0 



Mr. HiioM O. Ptoyd 
333 N« W« 10th msm 
Oettk. Florida 33070 



Mr« V$m B« 8tt3Mi 
5100 8« W« 7tk AfMiM 
Ofiftte, Florida 33070 



li^e appreciate the invitation to participate in the research jptrojfect^ ^Communication 
Problems of Vocational Educators iu th0'^^^€e'^igg^ and look forward to 

working with you in this effort:."^^ '^^:^'] 

In Marion County I would jimi^ tk^^ 
this project and to duK ciS^itact meai)er3 /for"' this 




advised concerning 
ject^ They ares 



JKil^if C^i3 ^^^^^^M 



fVe Aave taade considerable pzogre^t ia 7ocatiQa«J|^i9iEfti^ti#^ in 
rsatiize that much mora neAdTs to Jb« r ^ pain^diialJ^; inter^ 

efforts to furth&t improve t&» vfoodtlcmal education and jii^ J cai 
assistance in youi^ effq^ts pleam* ca21 ma* 



SMD/an 

CCi 




County and 
in your 
€ further 



SO If fi 'f 

Mr. Joe D. Mills, Director ' '^'^'^^'^^.^x^fn^^'^ 
Vocational^Tecbnical and Adult Education 
Department of Education 



Mr. Marion Roche 

Director, vocational Education 

Mr. Roland Best 

Ass^t. Director, Vocational Education 



Mr. Dean Kells 

Director, Curriculum Services 



Mr. Donald J. Kearsley 

Director of Federal Programs/Staff Coordinator 
O 149 

ERLC 



APPENDIX D 
TEACHER ASSESSMENT INQUIRY FORM 
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CODING FORM FOR TEACHER- STUDENT INTERACTION 
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APPENDIX F 

EXAMPLES OF POSITIVE AND NEGATIVE REINFORCEMENT 
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SUBJECT 
NO. 

075 

076 

077 

078 
079 

080 
081 
082 
083 
084 

085 
086 



087 
088 
089 



090 



091 



092 



POSITIVE REINFORCEMENT 
Pat 

Good; Got it 

Right; Good; OK; Better; 
Pat; OK; Right; Good; Pat; 
Nod 

Good; Pat; Smile 
Good 



Good 

Good; Very good; Right 
Pat 

Very good; Good; Fine; Pat 

Good; Smile; Nod 

Right; OK; Very good; Correct 
Right 



All right; Very good 



All right; Pretty good; Very 
good; Looking better; Looks 
good; Beautiful; Good; Very 
good 



That's good; Looks all 
right; That right; Looks 
good; Good 



NEGATIVE REINFORCEMENT 

No; No radio; Get busy; No; Stop 

Rough; Try again; Try again 



Wrong 

Too fast; Too high; Plat; Too 
close; Too big 

No 

Wrong; No 
Try again 



No; Wrong; Late; Out I; Flat; 
Careful 

Wrong; No 

Not right; Wired wrong; Still 
wired wrong; Not there; Don*t 
touch that; Wrong; No; Observing 
is not enough, I want you to 
do a reading. 

Bad job; No; Bad; Way off; Wrong 

You are all wrong. 

No 



Wrong; Wrong; You don't have good 
connections anywhere. 

Clean up; No; No; Didn't clean the 
drum; Lecture for skipping; Put 
that up; Not doing anything 

Slow down. 
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SUBJECT 

NO. POSITIVE REINFORCEMENT 



NEGATIVE REINFORCEMENT 



093 
094 
095 
096 

097 

098 
099 
100 
101 
102 



103 
105 
106 
107 



108 



109 
109 



OK; Good; Smile; Nod; Pat 

Right; Good; Pat; Smile 

Right; Good; Yes; Nod 

Better; Very good; Good; 
Right; Good; Very good 

Right 

Right 

Good; Right; Nod 
Right; Nod 

Good; Very good; Right; Got 
it; Nod; Pat; Smile; Good; 
Yes; Very good; Real good; 
Right; Smile; Nod 

Good; Smile; Right 

Good 



OK; Pretty Good; Nice; Real 
good; Good; Real Good; 100%; 
OK; You've got it; Good; OK; 
Good; Very good 



Looks like a winner; OK; 
Good; Good job; Good show; 
That's right 

Real good; Very good; Wonder- 
ful; Very good; Nicest one 
I've seen today; Wonderful; 
Very good; Looks good; Very 
nice; All right; Looks good; 
Very good; All right; Good; 
Very nice; Very nice; That's 
a boy; Very good; Nice; Looks 
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Wrong 

Wrong; Too hot; No 

Too fast; Too low; No: No sleep 

Wrong 

Get busy; Too cool; Wrong; Not 
quite; Keep busy; Too much 

Wrong 

No; Try again; Wrong 

Wrong; Too hot; Slow down. Unsafe 

No; Try again; Too small; Too 
fast; Slow down; Not quite; Not 
quite 

Wrong tool; Shake 



Wrong; No; Won't line up; Won't work 

Wrong vice; Too much pressure; Too 
big; Out too much; Crooked; Not 
quite; Too much pressure; Crooked; 
No; Need little more; Too tight; 
Don't press so hard; Too small; 
Split, no good; Really bad; Don't 
lubricate roller; Too much pressure; 
Too much pressure; Flat spot; No 

Wrong; Book dirty; Way off; Wrong; 
Point 



Not hot enough; Wrong; Never file 
backwards; Wrong 
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POSITIVE REINFORCEMENT NEGATIVE REINFORCEMENT 

good; Beautiful; Very 
good; Beautiful 

Wrong; Start proper diagnosis 
Wrong; Playing 

Looks good; Good; Good 
work; Good 

Becoming an expert; You 
did it; Beautiful; Very 
good; Good mechanic; Good 
mechanic; Point 
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SHOP RATING FORM 



Code No. 

Length of session (Mln.) 

(less time for breaks and/or 
lunch) 



Exc. 



Keeps everyone busy 

General vigor and enthusiasm 

Skill at clarifying directions 

Appearance of self-confidence 

Ability to create proper 
soc iai-emot ional climate 

Use of visual aids/models 

Skills at using visual aids/ 
models (if relevant) 



(often) 



2 
2 
2 
2 

2 

2 



3 
3 
3 

3 

3 
3 



k 
k 
k 

k 



Poor 
5 

5 

5 

5 

5 
5 



In general, how did instructor address students? 

First names only 

Last names only 



(never) 



Last names with courtesy title 
(Mr., Miss, Mrs.) 



Other (explain) 
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SHOP RATING FORM 
(cont inued) 



Code No. 

1. Estimate of time teacher stayed behind his desk or kept some 
other clear obstacle between himself and his students. 



2. Kinds of activities for which teacher showed enthusiasm. 



3. Kinds of activities for which teacher did not show enthusiasm. 



k. Heterogenity of activities among students (check one) 

All doing same thing 

Most doing same thing 

2 or 3 different kinds 

of activities 

4 or 5 different kinds 

of activities 

Almost all doing 

different things 

5. Kinds of activities or student behaviors which generally got POSITIVE 
reinforcement . 



6. Kinds of activities or student behaviors which generally got NEGATIVE 
re inforcement . 



7. Noise level Noisy Quiet 

8. Type of shop session Length of time 

Individual or group work projects 

Demonstration (for entire class) 

Other 
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SHOP RATING FORM 
(continued) 



Think througli the shop session you have just witnessed and note anything 
that struck you as particularly important regarding teacher-student inter- 
action in other words, a kind of overall impression of the learning 
environment. 
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CLASSROOM RATING SCALES 
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(Check only those categories 
that are relevant) 



Content of Material 

Organization of information 

Use of examples and illustration 
to clarify information 

Use of visual aids/models (often) 

List specific weaknesses/strengths 

Delivery of Material 

Vocal loudness 

Vocal rate 

Fluency 

Vocal variation 
Bodily action 

Noce any distracting body or 
vocal manner 



Other 



Skill at using visual aids/models 

Ability to create pleasant social- 
emotional environment 

Enthusiasm for material being taught 

Appearance of self-confidence 

Maintaining discipline 

Appropriateness of language 

Skill at generating discussion and 
quest ions 

Skill at showing relevance of material 
to students 

Ability to maintain student Interest 

Management of problem solving sessions 
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Exc« 
1 

1 



Code No, 

Length of session (Min.) 
(less time for breaks and /or 
lunch) 

Poor 

« 

2 3 5 



2 

2 



2 
2 
2 
2 
2 



2 
2 
2 
2 
2 



2 
2 
2 



3 
3 



3 
3 
3 
3 
3 



3 
3 
3 
3 
3 



3 
3 
3 



k 

k 
k 



k 
k 
k 
k 
k 



k 
k 



5 
5 
5 
5 
5 



5 
5 
5 
5 
5 



5 
5 
5 



(never) 
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CLASSROOM RAT ING FORM 
(cont !nued) 



Code No. 



K Estimate of time teacher stayed behind his desk or kept 
some other clear obstacle between himself and his student. 

2. Kinds of activities for which teacher showed enthusiasm. 



3. Kinds of activities for which teacher did not show enthusiasm. 



4. Kinds of activities or student behaviors which generally got POSITIVE rein- 
forcement . 



5. Kinds of activities or student behaviors which generally got NEGATIVE rein- 
forcement. 



6. Describe discursively the general relationship between teacher and students — 
formal vs. Informal, friendly banter, etc. 



7, Noise level 

Noisy Q."^et 

8. Type of classroom session Length of time 

General discussion 

Problem solving 

Lecture 

Demonstration ^ 

Other 
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CLASSROOM RATING FORM 
(continued) 

9. Think through the classroom session you have just witnessed and note anything 
that struck you as particularly Important regarding teacher-student interaction 
In other words, a kind of overall impression of the learning environment. 
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TEACHER- PROGRAM INFORMATION FORM 

Code No. 

1 . Drop rate 

a. No. of students in previous program 

b. No. of students v^ho dropped out (do not include 
those who left to take a ski 1 Is^related job) 

c. Rate (7) 

2. Absenteeism 

a. Ho. "Students in program 

b. No. of students absent 

c. Rate (%) 

3. Professional experience (practical experience) of 
teacher in months 

k. Educational experience 

a. No. of years of education beyond secondary level 

b. Courses in vocational education 

c. Courses in Communication (speech or interpersonal 
commun icat ion) 

d. Courses in psychology 
5« Teaching experience 

a. Total years 

b. Years teaching current subject matter 

c. Years at current school 

6. Age of teacher 

7. Ethnicity of teacher 
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APPENDIX J 
Q-SORT STATEMENTS (TEAQIER ATTITUDE) 
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Q-SORT STATEMENTS 



1. The number of hours a teacher must work is unreasonable. 

2. Our community makes its teachers feel as though they are not 
rc 'ly a part of the community. 

5. If I could cam as much money in another occiq)ation, I would stop 
teaching. 

I Tlje curriculum of our school is in need of major revision. 

5. Teachers in this school are not as competent as those in some 
other schools with which I am ::aTniliar. 

< . '"tuac-nis in this school generally tend to be misfits. 

?. If I could plan my career again, I would not choose teaching. 

8. This community expects its teachers to meet unreasonable personal 
standards . 

9. I think I am underpaid for what I do in this school. 

10. This school doesn't provide its teachers with adequate classroom 
supplies and equipment. 

11. I do not want to be close personal friends with most of the teachers 
in this school. 

12. In this school, I cannot insist on as high a standard in student 
performance as I would like. 

15. Teaching gives me a great deal of personal satisfaction. 

14. I feel that I am an important part of this school system. 

15. Salary policies are administered in this school district with 
fairness and justice. 

16. The head of our school does not understand or recognize good 
teaching. 

17. TH- • -^richers in our school cooperate well with each other to achieve 
pci> !ial and school goals. 

18. The primary function of this school is to keep these kids off the 
streets and out of trouble. 

19. Teaching enables me to make my greatest contribution to society. 
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Q-SORT STATEMENTS —Con t inued 



20. I feel reasonably successful in my present position. 

21. Teaching affords me the security I want in an occupation. 

22. Our school has a well-balanced curriculum. 

23. The teachers in this school are among the hardest -working group 
of people I know. 

24. I find my contacts with students, for the most part, highly 
satisfying and rewarding. 

2.S. I would recommend teaching as an occupation to students of high 
scholastic ability. 

26. The programs in our school make reasonable provision for individual 
differences among students. 

27. Most of the students in this school are very likeable. 

28. To me there is no more challenging work than teaching, 

29. The procedures for teachers to obtain materials ana services are 
well defined and efficient in this school. 
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Code No. _ 

(Not to be filled in by student) 

Date . 

Age of Student 

Number of months student has been under teacher's instruction , 

Highest grade student completed in school 

Directions: On the form below indicate with an _X_ the scale position which, 
in your judgment best describes your teacher. Marl< on position 
only. 

1. The teacher is highly interested in his work. 

strongly agree agree slightly disagree strongly 

agree slightly disagree disagree 

2. The teacher's actions seem to indicate that he is not very concerned about 
safety in the shop. 

strongly agree agree slightly disagree strongly 

agree slightly disagree disagree 

3. The teacher seems to have a deep respect for all students. 

strongly agn?e agree si ightly disagree strongly 

agree slightly disagree disagree 

k. The teacher never arrives on time and at the correct place. 

strongly agree agree slightly disagree srrongly 

agree slightly disagree disagree 

5. The teacher is always neat and dressed appropriately. 

strongly agree agree si Ightly disagree strongly 

agree slightly disagree disagree 

6. The teacher has a genuine interest in me— beyond how well I perform In his 
class. 

strongly agree agree slightly disagree strongly 

agree slightly disagree disagree 
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?• The teacher's work Is highly organized, 

strongly agree agree slightly disagree strongly 

agree slightly disagree disagree 

8. This program so far has been of little value to me. 

strong ly agree agree slightly disagree strongly 

agree slightly disagree disagree 

9. The instructor is far better than most teachers I have had. 



strongly agree agree slightly disagree strongly 

agree slightly disagree disagree 
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APPENDIX L 
Q-ANALYSIS OF TEACHER ATTITUDE RESPONSES 
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Q- ANALYSIS OF TEACHER ATTITUDE RESPONSES 



Each teacher in the sample rank ordered 29 items which dealt 
with such topics as perceptions of their students, of fellow teachers, 
of the compensation and status of teachers, and of the school. These 
data were subjected to a Q-analysis, using a special program, QUANAL, 
developed by Norman Van Tubergen at the University of Iowa.* A 
figure of 2.2 was set as the minimum eigen value factoring criterion. 
Twenty-five per cent was set as the per cent that a factor had to be 
negative for the program to split it into two types, and we asked 
for a maximum of five factors. The correlation matrix was evaluated 
for principal component factors and then an oblique rotation was 
attempted. This rotation was unsuccessful because of excessive 
complex roots and so we used a varimax (orthogonal) rotation instead. 

The most striking fact apparent in the results of the various 
analyses is the high level of agreement among teachers in the way in 
which they ordered the 29 attitude items. The correlation matrix 
among the 124 teachers was characterized by high positive co^ifficients. 
In one sense, the "best solution" may well be a single factor solution. 
With a five- factor solution, almost 75 per cent of the common variance 
is accounted for by the first factor in the principal components 
matrix. With the varimax rotation, 29 per cent of the common variance 
is accounted for by the first factor or type, 16 per cent by the 
second, 23 per cent by the third, 11 per cent by the fourth, and 22 
per cent by the fifth. However, as the table below shows, there is 
a high correlation among the five types. 





1 


2 


3 


4 


2 


.617 








3 


.858 


.704 






4 


.566 


.513 


.531 




5 


.747 


.698 


.787 


.514 



The most consistent attitudes among the teachers are those 
toward their students. The teacher tended to disagree strongly that 
"Students ir this school generally tend to be misfits" and to agree 
strongly that "Most of the students in this school are very likeable" 
and "I find my contacts with students, for the most part, highly 
satisfying and rewarding." Highly consistent also was disagreement 
with the statement that "Our -community makes its teachers feel as 
though they are not really a part of che community" and the agreement 
with the statement that "I fee? reasonably successful in my present 



*In library of Univ;*rsity of Iowa Computer Center. 
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position." The average z- scores for these consensus items are shown 
at the end of this section. (Since greatest agreement was scored 
1 and greatest disagreement was scored 24, a negative z-score indicates 
relative agreement and a positive z-scorc indicates relative disagree- 
ment . ) 

Though the agreement among these teachers in their ranking 
of attitude items was remarkably high, five "types" of teachers were 
detectable on the basis of their different orderings of the items. 
Three of the types were generally positive in their attitudes, while 
two were characterized by relatively negative attitudes. The items 
which distinguish each type are shown below. 

Among the positive teachers. Types I and V are quite similar. 
Both are reasonably satisfied with their teaching careers, though for 
somewhat different reasons. Type I, whom we label the "High Social 
Identifier," likes and respects both his fellow teachers and the school. 
It is these factors, more than the act of teaching itself, which 
accounts for his satisfaction. Type V, on the other hand, is less 
satisfied with the school, though he respects his fellow teachers, 
and he finds teaching itself challenging and rewarding. We identify 
him as the "Dedicated Teacher." 

The third type whom we found showed a high level of satisfaction 
we call the "Low Ego." His satisfaction seems to result from the fact 
that he sees teac'-ing as a profession either consistent with or above 
his abilities and aspirations. Of the three positive types, he is the 
most satisfied. He is. listed as Type III below. 

Type II appears to be the opposite of Type III and so we call 
him the "High Ego." He does not believe that his value to the school 
or the amount and quality of work that he does is adequately recognized 
or rewarded; he does not have much respect for the school, and he would 
not recommend teaching s.s an occupation for bright students. 

Type IV is the other negative type. We label him the "Isolate" 
because he neither likes nor respects his fellow teachers and he does not 
believe that he is an important part of the school system. He would 
prefer not to be a teacher. 

To clarify the types, and further explicate the data, the 
information below is provided: 



Type I: The "High Social Identifier." This type is distinguished by: 

a. a very high level of satisfaction with the school and its 
procedures C«?specially as contrasted with Type V). 

b. liking and respect for fellow teachers (which 'contrasts 
sharply with the attitudes of Type IV) . 
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c» the desire to continue teaching. 

the belief that the school has a well-balanced curriculum 
and that it provides adequately for differences among 
students* 

e. the fact that in spite of all of those things* teaching 
itself does not give a great deal of satisfaction. 

Type II: The "High Ego." This type teacher is characterized by: 

a. his belief that he is an important part of the school 
system and that teaching gives him personal satisfaction. 

b. dissatisfaction with the recognition or expectations 
of the school head and the community. 

c. dissatisfaction with the school's procedures and 
curriculum. 

d. the fact that he would not recommend teaching as a 
profession for bright students. 

Type III: The "Low Ego." He is characterized by the following kinds 
of beliefs: 

a. he finds teaching challenging and beli^es that he can 
make his greatest contribution to society through 
teaching. 

b. he also likes the security that teaching gives him and 
does not complain about his salary. 

c. unlike other teachers, he is not dissatisfied with the 
kinds of standards of student performance that he can 
insist on in this school. 

Type IV: The "Isolate/* This type of teacher is distinguished I 

a. his lack of respect and liking for other teachers. 

b. his dissatisfaction with the salary that he receives 
and the number of hours he must work. 

c. the fact that he does not consider himself an important 
part of the school system and does not think that he is 
making his greatest contribution to society through 
teaching. 

d. the belief that he would not choose teaching if he were 
given the chance to plan his career again. 

Type V- The "Dedicated Teacher." This last type is characterized in 
the following manner: 

a. he is less satisfied than the other types with the standards 
that he can set for students in his school and with the 
materials which the school provides for teaching. 

b. he believes that teaching is ,t good profession to recommend 
to bright students. 
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c. he is satisfied with the administrator of his school* 
his fellow teachers, and the conmunity. 

d. he would definitely choose teaching again if ho were 
replanning his career. 
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THACHER TYPES 



Type I: "High Social Identifier" 



Scored these items higher than Diffeiences from 

other types did Z-scoro average Z 



The procedures for teachers to obtain 
materials and services are well defined 
and efficient in this school. 


-0.941 


-1.047 


Our school has a well-balanced curriculum. 


-1.246 


-1.035; 


The programs in our school make reasonable 
students. 


- 1 . 068 


-0.757 


1 ne TcacnciS in Lnis bcnoui ure ujnuiig uiic 
hardest working group of people I know. 


-0.713 


-0.744 


The teachers in our school cooperate well 
With each other to achieve personal ana 
school Roals. 


-1.103 


-0.669 


Scored these items lower than other 
types did 


Z-score 


Differences from 
average Z 


This school doesn't provide its teachers 
with adequate classroom supplies and 
equipment . 


0.933 


1.023 


To me there is no more challenging work 
than teaching . 


-0.644 


0.866 


! do not want to be close personal 
friends with most of the teachers in 
this school . 


1.08 J 


0.776 


If I could earn as much money in another 
occupation, I would 5top teaching. 


1.399 


0.529 


Teaching gives me a great deal of personal 
satisfaction . 


-1.302 


0.479 
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Type H: "High Ego" 



Scored these items higher than 
other types did 



Z-score 



Differences from 
average 2 



The number of hours a teacher naist 

work is unreasonable. 0.001 -1.210 

The head of our school does not under- 
stand or recognize good teaching. -0.143 -1.192 

Teaching gives me a great deal of personal 

satisfaction. -2.343 -0.823 

This community expects its teachers to 

meet unreasonable personal standards. 0.222 -0.806 

I feel that I am an important part of 

this school system. -1.412 -0.581 

The primary function of this school is 
to keep there kids off the streets and 

out of trouble. 0.987 -0.499 



Scored these items lower than 
other types did 



2-score 



Differences from 
average Z 



The procedures for teachers to obtain 
materials and services are well defined 

and efficient in this school . 0.924 1.284 

I would recommend teaching as an occupation 

to students of high scholastic ability. 1.224 1.235 

Teaching affords me the security I want 

in an occupation . 1.035 1.161 

The program in our school makes reasonable 
provision for individual «Ufferences among 

student:- . 0.385 1.058 

Our school /has a well-balanced curriculum.. 0.245 0.828 
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Type III: "Low Ego" 



Scored these items higher than 


Z-score 


Differences 
average Z 


from 


Teaching affords me the security I want 


-0.931 


-1.297 




Teaching enables me to make my greatest 
contribution to society. 


-1.794 


-0.918 




To me, there is no more challenging 
work than teaching. 


-1.908 


-0.714 




Scored these items lower than other 
types did 


Z-score 


Differences 
average Z 


from 


I think I am underpaid for what I do 
in this school. 


1.010 


1.0S8 




In this school, I cannot insist on as 
high a standard in student performance 
as I would like. 


0.761 


0.952 
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Type IV: "Isolace" 



Scored these items nigner tnan 
other types did 


• 

2 -score 


Differences 
average Z 


from 


I think I am underpaid for what I do in 
this school. 


-1.385 


-1.936 




If I could plan my career again, I would 
not choose teaching. 


-0.357 


-1.515 




I do not want to be close personal friends 
with most of the teachers in this school. 


-0.627 


-1.360 




If I could earn as much money in another 
occupation, I would stop teaching. 


0.073 


-1.128 




Teachers in this school are not as 
competent as those in some other schools 
with which I am familiar. 


0.023 


-0.870 




Scored these items lower than 
other types did 


Z- score 


Differences 
average Z 


from 


The teachers in this school are among the 
hardest -working group or people i Know. 




1 201 




The primary function of this school is 
to kocp these Kias otr trie sureet ana out 
of trouble. 


2.310 


1.154 




Tne teachers in our school cooperate 
well with each other to achieve personal 
and school goals* 


0.176 


1.056 




The number of hours a teacher must work 
is unreasonable. 


1.725 


0.945 




I feel that I am an important part of this 
school system. 


-0.282 


0.831 




Teaching enables me to make my greatest 
contribution to society • 


-0.529 


0.663 
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Type V: Dedicated Teacher" 



Scored these iteios higher than 
other types did 


Z-score 


uixierences 
average Z 


rTOID 


In this school, I cannot insist on as 
high a standard in student perfomance 
as I would like* 


-1.080 


-1.349 




Th^" school doesn*t provide its teachers 
with adcqu'itj classroom supplies and 

equi;^:''-.nt. 


-0.925 


-1.299 




I would recoTPjiend teaching as an 
occupation to students ot nign 
scholastic ability- 


-0.605 


-1.051 




Scored these items lower than 
other types did 


Z -score 


Uixierences 
average Z 


zroiB 


The head of our school does not 
understand or recognize good 
teaching • 


1.546 


0.919 




Teachers in this school are not as 
competent as those in some other 
schools with which I am familiar • 


1.217 


0.623 




If I could plan ray career again, I 
would not choose teaching • 


1.332 


0.596 




This conraiunity expects its teachers to 
meet unreasonable personal standards. 


1.230 


0.454 
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Consensus items: (Range of 1>000 or less) 


Average Z-score 


I find my contacts with students, for the most part. 


-1.44 


highly satisfying and rewarding . 


I feel reasonably successful in my present position. 


-1.14 


MOSt or tne stuoents xn tnis »cnouji are very xi&cauxo* 


-1.00 


Salary policies are administered in this school 


0.03 


district with fairness and justice. 


The curriculum of our school is in need of major 




revision . 


0.51 


Our community makes its teachers feel as though 


1.01 


they are not real ly a part of the community . 


Students in this school generally tend to be misfits. 


1.06 
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APPENDIX M 
POSITIVE AND NEGATIVE NARRATIVES 
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FIRST DAY 



This instructor conducts a busy, cheerful class in a roony, well- 
equipped shop. He makes extensive use of positive reinforcement, 
frequently employs friendly banter, and did not (at least 0uring 
this first day of observation) employ any negative reinforcement 
of even the mildest variety. 

The jobs undertaken by the students are not exercises but bona 
fide repair jobs of varying complexity and difficulty; there are, 
however, several exercise engines and one stripped-down truck 
available for exercise work. The instructor seldom takes an active 
part in the work, but is continuously moving about the shop super- 
vising progress and proficiency. His supervisory efforts are 
carefully masked as rather casual remarks or questions in passing, 
and he never communicates a hint of the Big-Brother- is -watching image, 
yet nothing escapes him. He will frequently spend several minutes 
with a team or small group, but for the most part this time is spent 
in listening to the students describe their problems and making 
mild suggestions or asking pointed, leading questions until the 
students arrive at the answer/solution themselves. 



SECOND DAY 

The observations and impressions gathered during the first day»s 
observed period were generally reinforced and strengthened during 
this second day. The instructor spent a great deal more time 
with the several teams or small groups engaged in several tasks, 
but he utilized the same technique as before, i.e., he took no 
active part in the work although he frequently handled tools and/or 
parts, and coached the students over problem areas with mild 
suggestions and/or pointed, leading questions so that the students 
arrived at the answer/ solution themselves. As on the fi^st day, he 
made frequent use of banter and positive reinforcement. However, 
as nearly as I could tell (not being a mechanic), there was no 
occasion for negative reinforcement. 
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FIRST DAY 



The instructor spent the entire period touring, checking, and working 
with the students. There was a very friendly atmosphere and the 
students were as free to make contacts with the instructor as he was 
with them. He didn»t stay with each person very long, but he made 
several contacts with each student (or most of them). Notice the 
amount of banter — this didn't hurt the progress of work because the 
students worked the entire period. 

The students were praised when they had done a good job on their projects. 
The instructor gave the reinforcement enthusiastically and repeated it 
several times. The two negative reinforcements on safety were (1) when 
student #2 was grinding a part down without safety glasses and the 
instructor stopped him and made him put the glasses on; and (2) when 
student #9 was hooking up a tank of nitrogen to his unit and he turned 
it on before he had it hooked up properly. It shot the plug off and 
started spraying. No one was hurt. The instructor's coianent: "What 
did you do? — Where is your head? You know you don't do that." 

aae rather neat sideline which I thought was interesting -- the instructor 
spins a wheel to determine who will assume the clean-up duties. The 
students accept their respor<<ibilities. The relationship between students 
and teacher is open, friendly, and warm. The soci'al-emotional atmosphere 
is great. 

Good session! 



SECOND DAY 

Again, today the instructor was on the move constantly. He keeps moving 
from one group to another which I think keeps them fairly busy (except 
for a few who wander around a lot of the time). 

One thing I especially noted about the instructor is his friendliness 
with the students and his interest in them. He doesn't give out positive 
reinforcement unless it is deserved and I think the students know they 
have done a good job when they do receive praise. 

There is much activity in the class with everyone working and watching 
others work when they are free. There is much freedom in the shop and 
an informal atmosphere. 
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FIRST DAY 



The instructor started the day by taking a half-hour break while 
several of the students went tC' work in the shap. I didn't count 
it as a legal break because so many of the students stayed in the 
shop. When he returned, he chc>cked on what the students were doing 
and if they needed help, he would work with them. 

For the amount of time spent in the shop, there were few contacts 
made. Notice that there is no praise but four instances of criticism. 
The instructor worked more with the groups than he did with individual 
students. The students cane arid went at will and at times there 
were few students in the shop. Notice the amount of time spent in 
interruptions. The instructor didn*t seem to mind. 



SECOND DAY 

Today's session was like yesterday's in many ways. There were a number 
of interruptions and the instructor didn't seem to mind them; in fact, 
he verged on welcoming them- After the classroom session was over, 
the instructor took a half-hour break while some students stayed in the 
shop to work. After he got back, he checked around to see what the 
students were doing. Then he stood back and watched. Some of the 
students had to wait on parts and in the time they had to wait, he did 
nothing. Some of the students also disappeared for extended periods 
of time and the instructor didn'i: seem to mind. During the afternoon 
session, the instructor took a 3r> minute break. Again, some of the 
students stayed in the shop unsupervised. The instructor worked with 
one group more than the others. Also, there were a couple of people 
who received little help at all. 
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FIRST DAY 

The first ten minutes were used for administrative purposes. The 
instructor then had a film to show on fiberglass. Most students were 
attentive, but there was some talking. The class was dismissed to the 
shop right after the film. No explanation of the film's relevance was 
given. (The film was about fiberglass and the students couldn»t completely 
understand the relevance.) The instructor had no real introduction 
either. He yelled at the students to settle down and get ready for the 
film. The class was unruly at first but settled down when the film 
started. 

The classroom is again a very small section of the shop where the students 
put up folding desks to sit in. They bunch up into an even smaller area 
creating tight, close quarters which may be the reason why there is so 
much confusion. The instructor's overt behavior doesn't help though. 



SECOND DAY 

The class was a problem- solving session. The instructor passed out a 
work sheet on fractions. The class session was almost mass bedlam. 
The students talked more than they worked on the problems. They griped 
about the way the drawing had been done. The students didn't know how 
to do the problems and instead of the instructor helping them, he 
yelled at them for not working on the problem. I don't see how those 
who were working could concentrate because there was so much confusion 
in the room. There was a continuous verbal battle going on between the 
instructor and one of the students. 

The session could have been handled in a more organized and comprehensive 
way. The instructor could have gained the interest of the students by 
working each problem with them and helping them as he went along. The 
session was, however, very disorganized. 
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